2021-03-09 17:23:06.904: INFO @api : Created output directory with name log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:23:06.904: INFO @api : Creating dataset 2021-03-09 17:23:08.084: WARNING @lazy_loader : The TensorFlow contrib module will not be included in TensorFlow 2.0. For more information, please see: * https://github.com/tensorflow/community/blob/master/rfcs/20180907-contrib-sunset.md * https://github.com/tensorflow/addons * https://github.com/tensorflow/io (for I/O related ops) If you depend on functionality not listed there, please file an issue. 2021-03-09 17:23:08.086: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/utils/profiler.py:12: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead. 2021-03-09 17:23:08.556: INFO @api : RecognitionDatasetWrapper created 2021-03-09 17:23:08.556: INFO @api : Creating a model 2021-03-09 17:23:08.574: INFO @model : Creating TF model on 1 GPU devices 2021-03-09 17:23:08.575: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/model.py:427: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead. 2021-03-09 17:23:08.764: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/model.py:142: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variable_scope instead. 2021-03-09 17:23:08.764: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/model.py:142: The name tf.get_variable_scope is deprecated. Please use tf.compat.v1.get_variable_scope instead. 2021-03-09 17:23:08.764: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/model.py:142: The name tf.AUTO_REUSE is deprecated. Please use tf.compat.v1.AUTO_REUSE instead. 2021-03-09 17:23:08.765: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/model.py:143: The name tf.placeholder_with_default is deprecated. Please use tf.compat.v1.placeholder_with_default instead. 2021-03-09 17:23:08.767: WARNING @module_wrapper: From /home/kopalja/faces/models/recognition.py:102: The name tf.placeholder is deprecated. Please use tf.compat.v1.placeholder instead. 2021-03-09 17:23:08.771: WARNING @deprecation : From /usr/lib/python3.8/site-packages/tensorflow_core/contrib/layers/python/layers/layers.py:1057: Layer.apply (from tensorflow.python.keras.engine.base_layer) is deprecated and will be removed in a future version. Instructions for updating: Please use `layer.__call__` method instead. 2021-03-09 17:23:09.227: WARNING @deprecation : From /home/kopalja/faces/models/recognition.py:112: flatten (from tensorflow.python.layers.core) is deprecated and will be removed in a future version. Instructions for updating: Use keras.layers.flatten instead. 2021-03-09 17:23:09.233: WARNING @deprecation : From /home/kopalja/faces/models/recognition.py:113: dropout (from tensorflow.python.layers.core) is deprecated and will be removed in a future version. Instructions for updating: Use keras.layers.dropout instead. 2021-03-09 17:23:09.243: WARNING @deprecation : From /home/kopalja/faces/models/recognition.py:115: dense (from tensorflow.python.layers.core) is deprecated and will be removed in a future version. Instructions for updating: Use keras.layers.Dense instead. 2021-03-09 17:23:09.319: WARNING @module_wrapper: From /home/kopalja/faces/models/recognition.py:47: The name tf.is_nan is deprecated. Please use tf.math.is_nan instead. 2021-03-09 17:23:09.321: WARNING @deprecation : From /home/kopalja/faces/models/recognition.py:47: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.where in 2.0, which has the same broadcast rule as np.where 2021-03-09 17:23:09.361: INFO @recognition : Using regression model with L1 loss 2021-03-09 17:23:09.374: WARNING @deprecation : From /home/kopalja/faces/models/recognition.py:171: softmax_cross_entropy_with_logits (from tensorflow.python.ops.nn_ops) is deprecated and will be removed in a future version. Instructions for updating: Future major versions of TensorFlow will allow gradients to flow into the labels input on backprop by default. See `tf.nn.softmax_cross_entropy_with_logits_v2`. 2021-03-09 17:23:09.397: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/model.py:149: The name tf.GraphKeys is deprecated. Please use tf.compat.v1.GraphKeys instead. 2021-03-09 17:23:09.397: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/graph_tower.py:80: The name tf.get_default_graph is deprecated. Please use tf.compat.v1.get_default_graph instead. 2021-03-09 17:23:10.503: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/model.py:182: The name tf.train.Saver is deprecated. Please use tf.compat.v1.train.Saver instead. 2021-03-09 17:23:10.581: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/model.py:516: The name tf.global_variables_initializer is deprecated. Please use tf.compat.v1.global_variables_initializer instead. 2021-03-09 17:23:11.289: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/model.py:517: The name tf.local_variables_initializer is deprecated. Please use tf.compat.v1.local_variables_initializer instead. 2021-03-09 17:23:11.409: INFO @model : Number of parameters: 777707 2021-03-09 17:23:11.409: INFO @api : RecognitionModel created 2021-03-09 17:23:11.410: INFO @api : Creating hooks 2021-03-09 17:23:11.416: INFO @api : ComputeStats created 2021-03-09 17:23:11.417: INFO @api : LogVariables created 2021-03-09 17:23:11.418: INFO @api : LogProfile created 2021-03-09 17:23:11.419: INFO @api : LogDir created 2021-03-09 17:23:11.495: INFO @loader : Loading faiss with AVX2 support. 2021-03-09 17:23:11.495: INFO @loader : Loading faiss. 2021-03-09 17:23:11.648: WARNING @abstract_hook: Argument `n_epochs` was not recognized by `ComputeRecognitionMetrics`. Recognized arguments are `['output_dir', 'skip_epochs', 'streams', 'kwargs']`. 2021-03-09 17:23:11.648: INFO @api : ComputeRecognitionMetrics created 2021-03-09 17:23:11.648: INFO @api : ComputeRecognitionMaeCategories created 2021-03-09 17:23:11.648: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/hooks/write_tensorboard.py:68: The name tf.summary.FileWriter is deprecated. Please use tf.compat.v1.summary.FileWriter instead. 2021-03-09 17:23:11.649: INFO @api : WriteTensorBoard created 2021-03-09 17:23:11.649: INFO @api : DecayLR created 2021-03-09 17:23:11.650: INFO @api : SaveEvery created 2021-03-09 17:23:11.650: INFO @api : StopAfter created 2021-03-09 17:23:11.651: INFO @api : ShowProgress created 2021-03-09 17:23:11.651: WARNING @api : TrainingTrace hook added between hooks. Add it to your config.yaml to suppress this warning. 2021-03-09 17:23:11.651: INFO @api : Creating main loop 2021-03-09 17:23:11.651: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:23:11.652: INFO @main_loop : Training epoch 1 2021-03-09 17:23:12.057: WARNING @main_loop : Some sources provided by the stream do not match model placeholders. Set `main_loop.on_unused_sources` to `ignore` in order to suppress this warning. Extra sources: ['orig_box', 'box_points', 'filenames'] 2021-03-09 17:23:33.189: INFO @log_variables: train loss nanmean: 2.960786 2021-03-09 17:23:33.189: INFO @log_variables: train age_loss mean: 23.135475 2021-03-09 17:23:33.189: INFO @log_variables: train gender_loss mean: 0.798025 2021-03-09 17:23:33.189: INFO @log_variables: train age_mae mean: 21.829586 2021-03-09 17:23:33.189: INFO @log_variables: train gender_accuracy mean: 0.527633 2021-03-09 17:23:33.189: INFO @log_variables: train gender_confidence/loss nanmean: 0.088560 2021-03-09 17:23:33.189: INFO @log_variables: train gender_confidence/accuracy mean: 0.504702 2021-03-09 17:23:33.189: INFO @log_variables: train age_confidence/loss mean: 0.043524 2021-03-09 17:23:33.189: INFO @log_variables: train age_confidence/accuracy mean: 0.782118 2021-03-09 17:23:33.189: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:23:33.191: INFO @metrics_hook: train age_mae: 21.830 +-0.269 (13824) 2021-03-09 17:23:33.193: INFO @metrics_hook: train gender_accuracy: 0.528 +-0.008 (13824) 2021-03-09 17:23:35.883: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/hooks/write_tensorboard.py:102: The name tf.Summary is deprecated. Please use tf.compat.v1.Summary instead. 2021-03-09 17:23:35.965: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/hooks/decay_lr.py:89: The name tf.assign is deprecated. Please use tf.compat.v1.assign instead. 2021-03-09 17:23:36.163: INFO @decay_lr : LR updated to `0.0002985` 2021-03-09 17:23:36.166: INFO @log_profile : T train: 20.265804 2021-03-09 17:23:36.166: INFO @log_profile : T read data: 0.768824 2021-03-09 17:23:36.166: INFO @log_profile : T hooks: 3.426220 2021-03-09 17:23:36.166: INFO @main_loop : Epoch 1 done 2021-03-09 17:23:36.166: INFO @main_loop : Training epoch 2 2021-03-09 17:23:55.077: INFO @log_variables: train loss nanmean: 2.534492 2021-03-09 17:23:55.078: INFO @log_variables: train age_loss mean: 19.218506 2021-03-09 17:23:55.078: INFO @log_variables: train gender_loss mean: 0.731572 2021-03-09 17:23:55.078: INFO @log_variables: train age_mae mean: 18.080814 2021-03-09 17:23:55.079: INFO @log_variables: train gender_accuracy mean: 0.538918 2021-03-09 17:23:55.079: INFO @log_variables: train gender_confidence/loss nanmean: 0.080484 2021-03-09 17:23:55.079: INFO @log_variables: train gender_confidence/accuracy mean: 0.509983 2021-03-09 17:23:55.079: INFO @log_variables: train age_confidence/loss mean: 0.041805 2021-03-09 17:23:55.079: INFO @log_variables: train age_confidence/accuracy mean: 0.787254 2021-03-09 17:23:55.080: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:23:55.082: INFO @metrics_hook: train age_mae: 18.081 +-0.208 (13824) 2021-03-09 17:23:55.084: INFO @metrics_hook: train gender_accuracy: 0.539 +-0.008 (13824) 2021-03-09 17:23:57.283: INFO @decay_lr : LR updated to `0.0002970075` 2021-03-09 17:23:57.285: INFO @log_profile : T train: 18.062958 2021-03-09 17:23:57.285: INFO @log_profile : T read data: 0.341340 2021-03-09 17:23:57.285: INFO @log_profile : T hooks: 2.664990 2021-03-09 17:23:57.286: INFO @main_loop : Epoch 2 done 2021-03-09 17:23:57.286: INFO @main_loop : Training epoch 3 2021-03-09 17:24:16.177: INFO @log_variables: train loss nanmean: 2.476929 2021-03-09 17:24:16.178: INFO @log_variables: train age_loss mean: 18.883778 2021-03-09 17:24:16.179: INFO @log_variables: train gender_loss mean: 0.706359 2021-03-09 17:24:16.179: INFO @log_variables: train age_mae mean: 17.826258 2021-03-09 17:24:16.179: INFO @log_variables: train gender_accuracy mean: 0.554832 2021-03-09 17:24:16.179: INFO @log_variables: train gender_confidence/loss nanmean: 0.077524 2021-03-09 17:24:16.179: INFO @log_variables: train gender_confidence/accuracy mean: 0.509766 2021-03-09 17:24:16.179: INFO @log_variables: train age_confidence/loss mean: 0.040553 2021-03-09 17:24:16.179: INFO @log_variables: train age_confidence/accuracy mean: 0.806279 2021-03-09 17:24:16.179: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:24:16.181: INFO @metrics_hook: train age_mae: 17.826 +-0.207 (13824) 2021-03-09 17:24:16.183: INFO @metrics_hook: train gender_accuracy: 0.555 +-0.008 (13824) 2021-03-09 17:24:18.850: INFO @decay_lr : LR updated to `0.00029552245` 2021-03-09 17:24:18.852: INFO @log_profile : T train: 17.997669 2021-03-09 17:24:18.852: INFO @log_profile : T read data: 0.365205 2021-03-09 17:24:18.852: INFO @log_profile : T hooks: 3.150860 2021-03-09 17:24:18.852: INFO @main_loop : Epoch 3 done 2021-03-09 17:24:18.852: INFO @main_loop : Training epoch 4 2021-03-09 17:24:37.546: INFO @log_variables: train loss nanmean: 2.454325 2021-03-09 17:24:37.546: INFO @log_variables: train age_loss mean: 18.831282 2021-03-09 17:24:37.546: INFO @log_variables: train gender_loss mean: 0.690533 2021-03-09 17:24:37.546: INFO @log_variables: train age_mae mean: 17.813055 2021-03-09 17:24:37.546: INFO @log_variables: train gender_accuracy mean: 0.565466 2021-03-09 17:24:37.546: INFO @log_variables: train gender_confidence/loss nanmean: 0.075940 2021-03-09 17:24:37.546: INFO @log_variables: train gender_confidence/accuracy mean: 0.520616 2021-03-09 17:24:37.546: INFO @log_variables: train age_confidence/loss mean: 0.038693 2021-03-09 17:24:37.546: INFO @log_variables: train age_confidence/accuracy mean: 0.820891 2021-03-09 17:24:37.546: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:24:37.548: INFO @metrics_hook: train age_mae: 17.813 +-0.206 (13824) 2021-03-09 17:24:37.550: INFO @metrics_hook: train gender_accuracy: 0.565 +-0.008 (13824) 2021-03-09 17:24:39.727: INFO @decay_lr : LR updated to `0.00029404485` 2021-03-09 17:24:39.729: INFO @log_profile : T train: 17.700508 2021-03-09 17:24:39.729: INFO @log_profile : T read data: 0.484326 2021-03-09 17:24:39.729: INFO @log_profile : T hooks: 2.642696 2021-03-09 17:24:39.729: INFO @main_loop : Epoch 4 done 2021-03-09 17:24:39.729: INFO @main_loop : Training epoch 5 2021-03-09 17:24:58.096: INFO @log_variables: train loss nanmean: 2.385801 2021-03-09 17:24:58.096: INFO @log_variables: train age_loss mean: 18.223751 2021-03-09 17:24:58.096: INFO @log_variables: train gender_loss mean: 0.675117 2021-03-09 17:24:58.096: INFO @log_variables: train age_mae mean: 17.245579 2021-03-09 17:24:58.096: INFO @log_variables: train gender_accuracy mean: 0.584852 2021-03-09 17:24:58.096: INFO @log_variables: train gender_confidence/loss nanmean: 0.075838 2021-03-09 17:24:58.096: INFO @log_variables: train gender_confidence/accuracy mean: 0.542752 2021-03-09 17:24:58.096: INFO @log_variables: train age_confidence/loss mean: 0.039516 2021-03-09 17:24:58.096: INFO @log_variables: train age_confidence/accuracy mean: 0.815683 2021-03-09 17:24:58.097: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:24:58.098: INFO @metrics_hook: train age_mae: 17.246 +-0.207 (13824) 2021-03-09 17:24:58.099: INFO @metrics_hook: train gender_accuracy: 0.585 +-0.008 (13824) 2021-03-09 17:25:00.126: INFO @decay_lr : LR updated to `0.0002925746` 2021-03-09 17:25:00.128: INFO @log_profile : T train: 17.497944 2021-03-09 17:25:00.128: INFO @log_profile : T read data: 0.311131 2021-03-09 17:25:00.128: INFO @log_profile : T hooks: 2.539335 2021-03-09 17:25:00.128: INFO @main_loop : Epoch 5 done 2021-03-09 17:25:00.128: INFO @main_loop : Training epoch 6 2021-03-09 17:25:18.517: INFO @log_variables: train loss nanmean: 2.352669 2021-03-09 17:25:18.517: INFO @log_variables: train age_loss mean: 17.925488 2021-03-09 17:25:18.517: INFO @log_variables: train gender_loss mean: 0.668909 2021-03-09 17:25:18.517: INFO @log_variables: train age_mae mean: 16.980417 2021-03-09 17:25:18.518: INFO @log_variables: train gender_accuracy mean: 0.593967 2021-03-09 17:25:18.518: INFO @log_variables: train gender_confidence/loss nanmean: 0.075649 2021-03-09 17:25:18.518: INFO @log_variables: train gender_confidence/accuracy mean: 0.552879 2021-03-09 17:25:18.518: INFO @log_variables: train age_confidence/loss mean: 0.039332 2021-03-09 17:25:18.518: INFO @log_variables: train age_confidence/accuracy mean: 0.819951 2021-03-09 17:25:18.518: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:25:18.520: INFO @metrics_hook: train age_mae: 16.980 +-0.205 (13824) 2021-03-09 17:25:18.522: INFO @metrics_hook: train gender_accuracy: 0.594 +-0.008 (13824) 2021-03-09 17:25:20.591: INFO @decay_lr : LR updated to `0.00029111173` 2021-03-09 17:25:20.592: INFO @log_profile : T train: 17.535676 2021-03-09 17:25:20.593: INFO @log_profile : T read data: 0.309696 2021-03-09 17:25:20.593: INFO @log_profile : T hooks: 2.570317 2021-03-09 17:25:20.593: INFO @main_loop : Epoch 6 done 2021-03-09 17:25:20.593: INFO @main_loop : Training epoch 7 2021-03-09 17:25:39.167: INFO @log_variables: train loss nanmean: 2.323139 2021-03-09 17:25:39.167: INFO @log_variables: train age_loss mean: 17.619698 2021-03-09 17:25:39.167: INFO @log_variables: train gender_loss mean: 0.666522 2021-03-09 17:25:39.167: INFO @log_variables: train age_mae mean: 16.702887 2021-03-09 17:25:39.167: INFO @log_variables: train gender_accuracy mean: 0.599248 2021-03-09 17:25:39.167: INFO @log_variables: train gender_confidence/loss nanmean: 0.075719 2021-03-09 17:25:39.168: INFO @log_variables: train gender_confidence/accuracy mean: 0.569806 2021-03-09 17:25:39.168: INFO @log_variables: train age_confidence/loss mean: 0.039701 2021-03-09 17:25:39.168: INFO @log_variables: train age_confidence/accuracy mean: 0.813368 2021-03-09 17:25:39.168: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:25:39.170: INFO @metrics_hook: train age_mae: 16.703 +-0.205 (13824) 2021-03-09 17:25:39.172: INFO @metrics_hook: train gender_accuracy: 0.599 +-0.008 (13824) 2021-03-09 17:25:41.097: INFO @decay_lr : LR updated to `0.00028965616` 2021-03-09 17:25:41.098: INFO @log_profile : T train: 17.563381 2021-03-09 17:25:41.098: INFO @log_profile : T read data: 0.440753 2021-03-09 17:25:41.098: INFO @log_profile : T hooks: 2.451932 2021-03-09 17:25:41.098: INFO @main_loop : Epoch 7 done 2021-03-09 17:25:41.098: INFO @main_loop : Training epoch 8 2021-03-09 17:25:59.565: INFO @log_variables: train loss nanmean: 2.290892 2021-03-09 17:25:59.565: INFO @log_variables: train age_loss mean: 17.338100 2021-03-09 17:25:59.565: INFO @log_variables: train gender_loss mean: 0.658619 2021-03-09 17:25:59.565: INFO @log_variables: train age_mae mean: 16.445772 2021-03-09 17:25:59.565: INFO @log_variables: train gender_accuracy mean: 0.607494 2021-03-09 17:25:59.565: INFO @log_variables: train gender_confidence/loss nanmean: 0.075806 2021-03-09 17:25:59.565: INFO @log_variables: train gender_confidence/accuracy mean: 0.577691 2021-03-09 17:25:59.565: INFO @log_variables: train age_confidence/loss mean: 0.040150 2021-03-09 17:25:59.566: INFO @log_variables: train age_confidence/accuracy mean: 0.813223 2021-03-09 17:25:59.566: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:25:59.568: INFO @metrics_hook: train age_mae: 16.446 +-0.205 (13824) 2021-03-09 17:25:59.570: INFO @metrics_hook: train gender_accuracy: 0.607 +-0.008 (13824) 2021-03-09 17:26:01.807: INFO @decay_lr : LR updated to `0.00028820787` 2021-03-09 17:26:01.808: INFO @log_profile : T train: 17.585401 2021-03-09 17:26:01.808: INFO @log_profile : T read data: 0.310617 2021-03-09 17:26:01.808: INFO @log_profile : T hooks: 2.763954 2021-03-09 17:26:01.808: INFO @main_loop : Epoch 8 done 2021-03-09 17:26:01.809: INFO @main_loop : Training epoch 9 2021-03-09 17:26:20.623: INFO @log_variables: train loss nanmean: 2.274496 2021-03-09 17:26:20.624: INFO @log_variables: train age_loss mean: 17.215034 2021-03-09 17:26:20.624: INFO @log_variables: train gender_loss mean: 0.651971 2021-03-09 17:26:20.624: INFO @log_variables: train age_mae mean: 16.338358 2021-03-09 17:26:20.624: INFO @log_variables: train gender_accuracy mean: 0.616536 2021-03-09 17:26:20.625: INFO @log_variables: train gender_confidence/loss nanmean: 0.076424 2021-03-09 17:26:20.625: INFO @log_variables: train gender_confidence/accuracy mean: 0.583912 2021-03-09 17:26:20.625: INFO @log_variables: train age_confidence/loss mean: 0.040368 2021-03-09 17:26:20.625: INFO @log_variables: train age_confidence/accuracy mean: 0.811921 2021-03-09 17:26:20.625: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:26:20.627: INFO @metrics_hook: train age_mae: 16.338 +-0.202 (13824) 2021-03-09 17:26:20.630: INFO @metrics_hook: train gender_accuracy: 0.617 +-0.008 (13824) 2021-03-09 17:26:23.397: INFO @decay_lr : LR updated to `0.00028676682` 2021-03-09 17:26:23.398: INFO @log_profile : T train: 17.948455 2021-03-09 17:26:23.398: INFO @log_profile : T read data: 0.348129 2021-03-09 17:26:23.398: INFO @log_profile : T hooks: 3.242552 2021-03-09 17:26:23.398: INFO @main_loop : Epoch 9 done 2021-03-09 17:26:23.398: INFO @main_loop : Training epoch 10 2021-03-09 17:26:43.313: INFO @log_variables: train loss nanmean: 2.227140 2021-03-09 17:26:43.313: INFO @log_variables: train age_loss mean: 16.700737 2021-03-09 17:26:43.313: INFO @log_variables: train gender_loss mean: 0.650174 2021-03-09 17:26:43.313: INFO @log_variables: train age_mae mean: 15.835373 2021-03-09 17:26:43.314: INFO @log_variables: train gender_accuracy mean: 0.622296 2021-03-09 17:26:43.314: INFO @log_variables: train gender_confidence/loss nanmean: 0.076734 2021-03-09 17:26:43.314: INFO @log_variables: train gender_confidence/accuracy mean: 0.593793 2021-03-09 17:26:43.314: INFO @log_variables: train age_confidence/loss mean: 0.041090 2021-03-09 17:26:43.314: INFO @log_variables: train age_confidence/accuracy mean: 0.806048 2021-03-09 17:26:43.314: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:26:43.316: INFO @metrics_hook: train age_mae: 15.835 +-0.200 (13823) 2021-03-09 17:26:43.318: INFO @metrics_hook: train gender_accuracy: 0.622 +-0.008 (13823) 2021-03-09 17:26:46.178: INFO @decay_lr : LR updated to `0.000285333` 2021-03-09 17:26:46.182: INFO @log_profile : T train: 18.870579 2021-03-09 17:26:46.182: INFO @log_profile : T read data: 0.526471 2021-03-09 17:26:46.182: INFO @log_profile : T hooks: 3.334885 2021-03-09 17:26:46.182: INFO @main_loop : Epoch 10 done 2021-03-09 17:26:46.183: INFO @main_loop : Training epoch 11 2021-03-09 17:27:08.135: INFO @log_variables: train loss nanmean: 2.203646 2021-03-09 17:27:08.135: INFO @log_variables: train age_loss mean: 16.515079 2021-03-09 17:27:08.135: INFO @log_variables: train gender_loss mean: 0.642369 2021-03-09 17:27:08.135: INFO @log_variables: train age_mae mean: 15.661401 2021-03-09 17:27:08.136: INFO @log_variables: train gender_accuracy mean: 0.632234 2021-03-09 17:27:08.136: INFO @log_variables: train gender_confidence/loss nanmean: 0.077015 2021-03-09 17:27:08.136: INFO @log_variables: train gender_confidence/accuracy mean: 0.601635 2021-03-09 17:27:08.136: INFO @log_variables: train age_confidence/loss mean: 0.041289 2021-03-09 17:27:08.136: INFO @log_variables: train age_confidence/accuracy mean: 0.802517 2021-03-09 17:27:08.136: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:27:08.138: INFO @metrics_hook: train age_mae: 15.661 +-0.201 (13824) 2021-03-09 17:27:08.140: INFO @metrics_hook: train gender_accuracy: 0.632 +-0.008 (13824) 2021-03-09 17:27:11.101: INFO @decay_lr : LR updated to `0.00028390632` 2021-03-09 17:27:11.104: INFO @log_profile : T train: 20.855061 2021-03-09 17:27:11.104: INFO @log_profile : T read data: 0.496819 2021-03-09 17:27:11.104: INFO @log_profile : T hooks: 3.512088 2021-03-09 17:27:11.104: INFO @main_loop : Epoch 11 done 2021-03-09 17:27:11.104: INFO @main_loop : Training epoch 12 2021-03-09 17:27:30.977: INFO @log_variables: train loss nanmean: 2.184953 2021-03-09 17:27:30.977: INFO @log_variables: train age_loss mean: 16.379370 2021-03-09 17:27:30.977: INFO @log_variables: train gender_loss mean: 0.634926 2021-03-09 17:27:30.977: INFO @log_variables: train age_mae mean: 15.530762 2021-03-09 17:27:30.977: INFO @log_variables: train gender_accuracy mean: 0.636502 2021-03-09 17:27:30.977: INFO @log_variables: train gender_confidence/loss nanmean: 0.076676 2021-03-09 17:27:30.977: INFO @log_variables: train gender_confidence/accuracy mean: 0.608724 2021-03-09 17:27:30.977: INFO @log_variables: train age_confidence/loss mean: 0.042038 2021-03-09 17:27:30.978: INFO @log_variables: train age_confidence/accuracy mean: 0.795211 2021-03-09 17:27:30.978: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:27:30.980: INFO @metrics_hook: train age_mae: 15.531 +-0.200 (13824) 2021-03-09 17:27:30.982: INFO @metrics_hook: train gender_accuracy: 0.637 +-0.008 (13824) 2021-03-09 17:27:33.244: INFO @decay_lr : LR updated to `0.00028248678` 2021-03-09 17:27:33.246: INFO @log_profile : T train: 18.877112 2021-03-09 17:27:33.246: INFO @log_profile : T read data: 0.470500 2021-03-09 17:27:33.246: INFO @log_profile : T hooks: 2.740431 2021-03-09 17:27:33.246: INFO @main_loop : Epoch 12 done 2021-03-09 17:27:33.246: INFO @main_loop : Training epoch 13 2021-03-09 17:27:51.524: INFO @log_variables: train loss nanmean: 2.179059 2021-03-09 17:27:51.525: INFO @log_variables: train age_loss mean: 16.332083 2021-03-09 17:27:51.525: INFO @log_variables: train gender_loss mean: 0.632014 2021-03-09 17:27:51.525: INFO @log_variables: train age_mae mean: 15.492526 2021-03-09 17:27:51.525: INFO @log_variables: train gender_accuracy mean: 0.643348 2021-03-09 17:27:51.525: INFO @log_variables: train gender_confidence/loss nanmean: 0.077084 2021-03-09 17:27:51.525: INFO @log_variables: train gender_confidence/accuracy mean: 0.616581 2021-03-09 17:27:51.525: INFO @log_variables: train age_confidence/loss mean: 0.042682 2021-03-09 17:27:51.525: INFO @log_variables: train age_confidence/accuracy mean: 0.792809 2021-03-09 17:27:51.525: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:27:51.527: INFO @metrics_hook: train age_mae: 15.493 +-0.200 (13823) 2021-03-09 17:27:51.529: INFO @metrics_hook: train gender_accuracy: 0.643 +-0.008 (13823) 2021-03-09 17:27:54.515: INFO @decay_lr : LR updated to `0.00028107435` 2021-03-09 17:27:54.517: INFO @log_profile : T train: 17.285170 2021-03-09 17:27:54.517: INFO @log_profile : T read data: 0.469857 2021-03-09 17:27:54.517: INFO @log_profile : T hooks: 3.464529 2021-03-09 17:27:54.517: INFO @main_loop : Epoch 13 done 2021-03-09 17:27:54.517: INFO @main_loop : Training epoch 14 2021-03-09 17:28:15.624: INFO @log_variables: train loss nanmean: 2.149884 2021-03-09 17:28:15.626: INFO @log_variables: train age_loss mean: 16.052042 2021-03-09 17:28:15.627: INFO @log_variables: train gender_loss mean: 0.627771 2021-03-09 17:28:15.628: INFO @log_variables: train age_mae mean: 15.218730 2021-03-09 17:28:15.631: INFO @log_variables: train gender_accuracy mean: 0.646603 2021-03-09 17:28:15.632: INFO @log_variables: train gender_confidence/loss nanmean: 0.077405 2021-03-09 17:28:15.635: INFO @log_variables: train gender_confidence/accuracy mean: 0.622007 2021-03-09 17:28:15.636: INFO @log_variables: train age_confidence/loss mean: 0.042501 2021-03-09 17:28:15.636: INFO @log_variables: train age_confidence/accuracy mean: 0.795341 2021-03-09 17:28:15.636: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:28:15.640: INFO @metrics_hook: train age_mae: 15.219 +-0.198 (13823) 2021-03-09 17:28:15.643: INFO @metrics_hook: train gender_accuracy: 0.647 +-0.008 (13823) 2021-03-09 17:28:18.464: INFO @decay_lr : LR updated to `0.00027966898` 2021-03-09 17:28:18.467: INFO @log_profile : T train: 19.982163 2021-03-09 17:28:18.467: INFO @log_profile : T read data: 0.561468 2021-03-09 17:28:18.467: INFO @log_profile : T hooks: 3.339750 2021-03-09 17:28:18.467: INFO @main_loop : Epoch 14 done 2021-03-09 17:28:18.467: INFO @main_loop : Training epoch 15 2021-03-09 17:28:39.285: INFO @log_variables: train loss nanmean: 2.142059 2021-03-09 17:28:39.285: INFO @log_variables: train age_loss mean: 16.001652 2021-03-09 17:28:39.286: INFO @log_variables: train gender_loss mean: 0.623295 2021-03-09 17:28:39.286: INFO @log_variables: train age_mae mean: 15.177911 2021-03-09 17:28:39.286: INFO @log_variables: train gender_accuracy mean: 0.655744 2021-03-09 17:28:39.286: INFO @log_variables: train gender_confidence/loss nanmean: 0.077827 2021-03-09 17:28:39.286: INFO @log_variables: train gender_confidence/accuracy mean: 0.623409 2021-03-09 17:28:39.286: INFO @log_variables: train age_confidence/loss mean: 0.042904 2021-03-09 17:28:39.286: INFO @log_variables: train age_confidence/accuracy mean: 0.790365 2021-03-09 17:28:39.286: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:28:39.288: INFO @metrics_hook: train age_mae: 15.178 +-0.199 (13824) 2021-03-09 17:28:39.290: INFO @metrics_hook: train gender_accuracy: 0.656 +-0.008 (13824) 2021-03-09 17:28:42.585: INFO @decay_lr : LR updated to `0.00027827063` 2021-03-09 17:28:42.588: INFO @log_profile : T train: 19.726697 2021-03-09 17:28:42.589: INFO @log_profile : T read data: 0.551047 2021-03-09 17:28:42.589: INFO @log_profile : T hooks: 3.781607 2021-03-09 17:28:42.589: INFO @main_loop : Epoch 15 done 2021-03-09 17:28:42.589: INFO @main_loop : Training epoch 16 2021-03-09 17:29:02.978: INFO @log_variables: train loss nanmean: 2.120272 2021-03-09 17:29:02.978: INFO @log_variables: train age_loss mean: 15.888256 2021-03-09 17:29:02.978: INFO @log_variables: train gender_loss mean: 0.611168 2021-03-09 17:29:02.978: INFO @log_variables: train age_mae mean: 15.071587 2021-03-09 17:29:02.978: INFO @log_variables: train gender_accuracy mean: 0.664931 2021-03-09 17:29:02.978: INFO @log_variables: train gender_confidence/loss nanmean: 0.077871 2021-03-09 17:29:02.978: INFO @log_variables: train gender_confidence/accuracy mean: 0.634621 2021-03-09 17:29:02.978: INFO @log_variables: train age_confidence/loss mean: 0.042407 2021-03-09 17:29:02.978: INFO @log_variables: train age_confidence/accuracy mean: 0.796947 2021-03-09 17:29:02.978: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:29:02.980: INFO @metrics_hook: train age_mae: 15.072 +-0.196 (13824) 2021-03-09 17:29:02.982: INFO @metrics_hook: train gender_accuracy: 0.665 +-0.008 (13824) 2021-03-09 17:29:05.521: INFO @decay_lr : LR updated to `0.00027687926` 2021-03-09 17:29:05.524: INFO @log_profile : T train: 19.260432 2021-03-09 17:29:05.524: INFO @log_profile : T read data: 0.589790 2021-03-09 17:29:05.524: INFO @log_profile : T hooks: 3.030416 2021-03-09 17:29:05.524: INFO @main_loop : Epoch 16 done 2021-03-09 17:29:05.524: INFO @main_loop : Training epoch 17 2021-03-09 17:29:26.492: INFO @log_variables: train loss nanmean: 2.110048 2021-03-09 17:29:26.492: INFO @log_variables: train age_loss mean: 15.850579 2021-03-09 17:29:26.492: INFO @log_variables: train gender_loss mean: 0.602835 2021-03-09 17:29:26.492: INFO @log_variables: train age_mae mean: 15.035510 2021-03-09 17:29:26.492: INFO @log_variables: train gender_accuracy mean: 0.674551 2021-03-09 17:29:26.492: INFO @log_variables: train gender_confidence/loss nanmean: 0.078289 2021-03-09 17:29:26.493: INFO @log_variables: train gender_confidence/accuracy mean: 0.638817 2021-03-09 17:29:26.493: INFO @log_variables: train age_confidence/loss mean: 0.042765 2021-03-09 17:29:26.493: INFO @log_variables: train age_confidence/accuracy mean: 0.788194 2021-03-09 17:29:26.493: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:29:26.495: INFO @metrics_hook: train age_mae: 15.036 +-0.198 (13824) 2021-03-09 17:29:26.496: INFO @metrics_hook: train gender_accuracy: 0.675 +-0.008 (13824) 2021-03-09 17:29:29.284: INFO @decay_lr : LR updated to `0.00027549488` 2021-03-09 17:29:29.286: INFO @log_profile : T train: 19.932979 2021-03-09 17:29:29.286: INFO @log_profile : T read data: 0.482198 2021-03-09 17:29:29.286: INFO @log_profile : T hooks: 3.289815 2021-03-09 17:29:29.286: INFO @main_loop : Epoch 17 done 2021-03-09 17:29:29.286: INFO @main_loop : Training epoch 18 2021-03-09 17:29:49.790: INFO @log_variables: train loss nanmean: 2.082455 2021-03-09 17:29:49.792: INFO @log_variables: train age_loss mean: 15.577675 2021-03-09 17:29:49.794: INFO @log_variables: train gender_loss mean: 0.599531 2021-03-09 17:29:49.795: INFO @log_variables: train age_mae mean: 14.771588 2021-03-09 17:29:49.797: INFO @log_variables: train gender_accuracy mean: 0.674407 2021-03-09 17:29:49.800: INFO @log_variables: train gender_confidence/loss nanmean: 0.077932 2021-03-09 17:29:49.801: INFO @log_variables: train gender_confidence/accuracy mean: 0.649957 2021-03-09 17:29:49.803: INFO @log_variables: train age_confidence/loss mean: 0.043343 2021-03-09 17:29:49.804: INFO @log_variables: train age_confidence/accuracy mean: 0.787905 2021-03-09 17:29:49.805: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:29:49.810: INFO @metrics_hook: train age_mae: 14.772 +-0.196 (13824) 2021-03-09 17:29:49.813: INFO @metrics_hook: train gender_accuracy: 0.674 +-0.008 (13824) 2021-03-09 17:29:52.736: INFO @decay_lr : LR updated to `0.0002741174` 2021-03-09 17:29:52.739: INFO @log_profile : T train: 19.436180 2021-03-09 17:29:52.739: INFO @log_profile : T read data: 0.524597 2021-03-09 17:29:52.739: INFO @log_profile : T hooks: 3.437067 2021-03-09 17:29:52.739: INFO @main_loop : Epoch 18 done 2021-03-09 17:29:52.739: INFO @main_loop : Training epoch 19 2021-03-09 17:30:13.457: INFO @log_variables: train loss nanmean: 2.062779 2021-03-09 17:30:13.457: INFO @log_variables: train age_loss mean: 15.414654 2021-03-09 17:30:13.457: INFO @log_variables: train gender_loss mean: 0.593462 2021-03-09 17:30:13.457: INFO @log_variables: train age_mae mean: 14.613539 2021-03-09 17:30:13.457: INFO @log_variables: train gender_accuracy mean: 0.680194 2021-03-09 17:30:13.458: INFO @log_variables: train gender_confidence/loss nanmean: 0.078282 2021-03-09 17:30:13.458: INFO @log_variables: train gender_confidence/accuracy mean: 0.649161 2021-03-09 17:30:13.458: INFO @log_variables: train age_confidence/loss mean: 0.043654 2021-03-09 17:30:13.458: INFO @log_variables: train age_confidence/accuracy mean: 0.782769 2021-03-09 17:30:13.458: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:30:13.460: INFO @metrics_hook: train age_mae: 14.614 +-0.195 (13824) 2021-03-09 17:30:13.463: INFO @metrics_hook: train gender_accuracy: 0.680 +-0.008 (13824) 2021-03-09 17:30:16.319: INFO @decay_lr : LR updated to `0.0002727468` 2021-03-09 17:30:16.321: INFO @log_profile : T train: 19.726411 2021-03-09 17:30:16.321: INFO @log_profile : T read data: 0.443795 2021-03-09 17:30:16.321: INFO @log_profile : T hooks: 3.344695 2021-03-09 17:30:16.321: INFO @main_loop : Epoch 19 done 2021-03-09 17:30:16.321: INFO @main_loop : Training epoch 20 2021-03-09 17:30:36.914: INFO @log_variables: train loss nanmean: 2.052415 2021-03-09 17:30:36.914: INFO @log_variables: train age_loss mean: 15.382744 2021-03-09 17:30:36.914: INFO @log_variables: train gender_loss mean: 0.585226 2021-03-09 17:30:36.914: INFO @log_variables: train age_mae mean: 14.586500 2021-03-09 17:30:36.914: INFO @log_variables: train gender_accuracy mean: 0.687789 2021-03-09 17:30:36.914: INFO @log_variables: train gender_confidence/loss nanmean: 0.078118 2021-03-09 17:30:36.914: INFO @log_variables: train gender_confidence/accuracy mean: 0.650608 2021-03-09 17:30:36.914: INFO @log_variables: train age_confidence/loss mean: 0.043842 2021-03-09 17:30:36.914: INFO @log_variables: train age_confidence/accuracy mean: 0.782407 2021-03-09 17:30:36.914: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:30:36.916: INFO @metrics_hook: train age_mae: 14.587 +-0.197 (13824) 2021-03-09 17:30:36.917: INFO @metrics_hook: train gender_accuracy: 0.688 +-0.008 (13824) 2021-03-09 17:30:39.836: INFO @decay_lr : LR updated to `0.00027138306` 2021-03-09 17:30:39.838: INFO @log_profile : T train: 19.283773 2021-03-09 17:30:39.838: INFO @log_profile : T read data: 0.738275 2021-03-09 17:30:39.838: INFO @log_profile : T hooks: 3.436826 2021-03-09 17:30:39.838: INFO @main_loop : Epoch 20 done 2021-03-09 17:30:39.838: INFO @main_loop : Training epoch 21 2021-03-09 17:31:00.705: INFO @log_variables: train loss nanmean: 2.022524 2021-03-09 17:31:00.707: INFO @log_variables: train age_loss mean: 15.141719 2021-03-09 17:31:00.708: INFO @log_variables: train gender_loss mean: 0.575255 2021-03-09 17:31:00.710: INFO @log_variables: train age_mae mean: 14.349756 2021-03-09 17:31:00.712: INFO @log_variables: train gender_accuracy mean: 0.695530 2021-03-09 17:31:00.713: INFO @log_variables: train gender_confidence/loss nanmean: 0.078535 2021-03-09 17:31:00.714: INFO @log_variables: train gender_confidence/accuracy mean: 0.655237 2021-03-09 17:31:00.715: INFO @log_variables: train age_confidence/loss mean: 0.044510 2021-03-09 17:31:00.718: INFO @log_variables: train age_confidence/accuracy mean: 0.776548 2021-03-09 17:31:00.719: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:31:00.721: INFO @metrics_hook: train age_mae: 14.350 +-0.194 (13824) 2021-03-09 17:31:00.723: INFO @metrics_hook: train gender_accuracy: 0.696 +-0.008 (13824) 2021-03-09 17:31:04.115: INFO @decay_lr : LR updated to `0.00027002615` 2021-03-09 17:31:04.120: INFO @log_profile : T train: 19.826357 2021-03-09 17:31:04.121: INFO @log_profile : T read data: 0.481874 2021-03-09 17:31:04.123: INFO @log_profile : T hooks: 3.913064 2021-03-09 17:31:04.124: INFO @main_loop : Epoch 21 done 2021-03-09 17:31:04.126: INFO @main_loop : Training epoch 22 2021-03-09 17:31:23.695: INFO @log_variables: train loss nanmean: 2.015378 2021-03-09 17:31:23.695: INFO @log_variables: train age_loss mean: 15.155278 2021-03-09 17:31:23.696: INFO @log_variables: train gender_loss mean: 0.566698 2021-03-09 17:31:23.696: INFO @log_variables: train age_mae mean: 14.364916 2021-03-09 17:31:23.696: INFO @log_variables: train gender_accuracy mean: 0.705584 2021-03-09 17:31:23.696: INFO @log_variables: train gender_confidence/loss nanmean: 0.078660 2021-03-09 17:31:23.696: INFO @log_variables: train gender_confidence/accuracy mean: 0.667607 2021-03-09 17:31:23.696: INFO @log_variables: train age_confidence/loss mean: 0.043786 2021-03-09 17:31:23.696: INFO @log_variables: train age_confidence/accuracy mean: 0.783637 2021-03-09 17:31:23.696: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:31:23.699: INFO @metrics_hook: train age_mae: 14.365 +-0.192 (13824) 2021-03-09 17:31:23.702: INFO @metrics_hook: train gender_accuracy: 0.706 +-0.008 (13824) 2021-03-09 17:31:26.117: INFO @decay_lr : LR updated to `0.00026867603` 2021-03-09 17:31:26.119: INFO @log_profile : T train: 18.692370 2021-03-09 17:31:26.119: INFO @log_profile : T read data: 0.352033 2021-03-09 17:31:26.119: INFO @log_profile : T hooks: 2.898424 2021-03-09 17:31:26.119: INFO @main_loop : Epoch 22 done 2021-03-09 17:31:26.119: INFO @main_loop : Training epoch 23 2021-03-09 17:31:45.007: INFO @log_variables: train loss nanmean: 1.991688 2021-03-09 17:31:45.007: INFO @log_variables: train age_loss mean: 14.978467 2021-03-09 17:31:45.007: INFO @log_variables: train gender_loss mean: 0.557751 2021-03-09 17:31:45.007: INFO @log_variables: train age_mae mean: 14.193360 2021-03-09 17:31:45.008: INFO @log_variables: train gender_accuracy mean: 0.708767 2021-03-09 17:31:45.008: INFO @log_variables: train gender_confidence/loss nanmean: 0.078090 2021-03-09 17:31:45.008: INFO @log_variables: train gender_confidence/accuracy mean: 0.675275 2021-03-09 17:31:45.008: INFO @log_variables: train age_confidence/loss mean: 0.044874 2021-03-09 17:31:45.008: INFO @log_variables: train age_confidence/accuracy mean: 0.772425 2021-03-09 17:31:45.008: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:31:45.009: INFO @metrics_hook: train age_mae: 14.193 +-0.193 (13824) 2021-03-09 17:31:45.011: INFO @metrics_hook: train gender_accuracy: 0.709 +-0.008 (13824) 2021-03-09 17:31:47.073: INFO @decay_lr : LR updated to `0.00026733265` 2021-03-09 17:31:47.074: INFO @log_profile : T train: 17.891823 2021-03-09 17:31:47.074: INFO @log_profile : T read data: 0.439810 2021-03-09 17:31:47.074: INFO @log_profile : T hooks: 2.575343 2021-03-09 17:31:47.074: INFO @main_loop : Epoch 23 done 2021-03-09 17:31:47.074: INFO @main_loop : Training epoch 24 2021-03-09 17:32:06.084: INFO @log_variables: train loss nanmean: 1.993464 2021-03-09 17:32:06.085: INFO @log_variables: train age_loss mean: 14.987671 2021-03-09 17:32:06.085: INFO @log_variables: train gender_loss mean: 0.558292 2021-03-09 17:32:06.085: INFO @log_variables: train age_mae mean: 14.204441 2021-03-09 17:32:06.085: INFO @log_variables: train gender_accuracy mean: 0.713686 2021-03-09 17:32:06.085: INFO @log_variables: train gender_confidence/loss nanmean: 0.078382 2021-03-09 17:32:06.085: INFO @log_variables: train gender_confidence/accuracy mean: 0.668475 2021-03-09 17:32:06.085: INFO @log_variables: train age_confidence/loss mean: 0.045028 2021-03-09 17:32:06.085: INFO @log_variables: train age_confidence/accuracy mean: 0.771340 2021-03-09 17:32:06.085: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:32:06.087: INFO @metrics_hook: train age_mae: 14.204 +-0.193 (13824) 2021-03-09 17:32:06.089: INFO @metrics_hook: train gender_accuracy: 0.714 +-0.008 (13824) 2021-03-09 17:32:08.140: INFO @decay_lr : LR updated to `0.000265996` 2021-03-09 17:32:08.142: INFO @log_profile : T train: 18.173891 2021-03-09 17:32:08.142: INFO @log_profile : T read data: 0.296232 2021-03-09 17:32:08.142: INFO @log_profile : T hooks: 2.551301 2021-03-09 17:32:08.142: INFO @main_loop : Epoch 24 done 2021-03-09 17:32:08.142: INFO @main_loop : Training epoch 25 2021-03-09 17:32:27.062: INFO @log_variables: train loss nanmean: 1.970031 2021-03-09 17:32:27.062: INFO @log_variables: train age_loss mean: 14.777202 2021-03-09 17:32:27.062: INFO @log_variables: train gender_loss mean: 0.552880 2021-03-09 17:32:27.062: INFO @log_variables: train age_mae mean: 14.003520 2021-03-09 17:32:27.062: INFO @log_variables: train gender_accuracy mean: 0.715205 2021-03-09 17:32:27.063: INFO @log_variables: train gender_confidence/loss nanmean: 0.078797 2021-03-09 17:32:27.063: INFO @log_variables: train gender_confidence/accuracy mean: 0.662616 2021-03-09 17:32:27.063: INFO @log_variables: train age_confidence/loss mean: 0.045234 2021-03-09 17:32:27.063: INFO @log_variables: train age_confidence/accuracy mean: 0.768229 2021-03-09 17:32:27.063: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:32:27.065: INFO @metrics_hook: train age_mae: 14.004 +-0.191 (13824) 2021-03-09 17:32:27.067: INFO @metrics_hook: train gender_accuracy: 0.715 +-0.008 (13824) 2021-03-09 17:32:29.083: INFO @decay_lr : LR updated to `0.000264666` 2021-03-09 17:32:29.084: INFO @log_profile : T train: 18.056818 2021-03-09 17:32:29.085: INFO @log_profile : T read data: 0.300752 2021-03-09 17:32:29.085: INFO @log_profile : T hooks: 2.537140 2021-03-09 17:32:29.085: INFO @main_loop : Epoch 25 done 2021-03-09 17:32:29.085: INFO @main_loop : Training epoch 26 2021-03-09 17:32:48.352: INFO @log_variables: train loss nanmean: 1.944717 2021-03-09 17:32:48.352: INFO @log_variables: train age_loss mean: 14.721161 2021-03-09 17:32:48.352: INFO @log_variables: train gender_loss mean: 0.531759 2021-03-09 17:32:48.352: INFO @log_variables: train age_mae mean: 13.948726 2021-03-09 17:32:48.352: INFO @log_variables: train gender_accuracy mean: 0.732350 2021-03-09 17:32:48.353: INFO @log_variables: train gender_confidence/loss nanmean: 0.078391 2021-03-09 17:32:48.353: INFO @log_variables: train gender_confidence/accuracy mean: 0.682364 2021-03-09 17:32:48.353: INFO @log_variables: train age_confidence/loss mean: 0.044621 2021-03-09 17:32:48.353: INFO @log_variables: train age_confidence/accuracy mean: 0.773003 2021-03-09 17:32:48.353: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:32:48.355: INFO @metrics_hook: train age_mae: 13.949 +-0.189 (13824) 2021-03-09 17:32:48.356: INFO @metrics_hook: train gender_accuracy: 0.732 +-0.008 (13824) 2021-03-09 17:32:50.615: INFO @decay_lr : LR updated to `0.0002633427` 2021-03-09 17:32:50.617: INFO @log_profile : T train: 18.298522 2021-03-09 17:32:50.617: INFO @log_profile : T read data: 0.446326 2021-03-09 17:32:50.617: INFO @log_profile : T hooks: 2.737929 2021-03-09 17:32:50.617: INFO @main_loop : Epoch 26 done 2021-03-09 17:32:50.617: INFO @main_loop : Training epoch 27 2021-03-09 17:33:10.073: INFO @log_variables: train loss nanmean: 1.945729 2021-03-09 17:33:10.073: INFO @log_variables: train age_loss mean: 14.683506 2021-03-09 17:33:10.073: INFO @log_variables: train gender_loss mean: 0.536464 2021-03-09 17:33:10.073: INFO @log_variables: train age_mae mean: 13.915112 2021-03-09 17:33:10.073: INFO @log_variables: train gender_accuracy mean: 0.727865 2021-03-09 17:33:10.073: INFO @log_variables: train gender_confidence/loss nanmean: 0.078269 2021-03-09 17:33:10.073: INFO @log_variables: train gender_confidence/accuracy mean: 0.677445 2021-03-09 17:33:10.073: INFO @log_variables: train age_confidence/loss mean: 0.044901 2021-03-09 17:33:10.073: INFO @log_variables: train age_confidence/accuracy mean: 0.772859 2021-03-09 17:33:10.073: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:33:10.075: INFO @metrics_hook: train age_mae: 13.915 +-0.192 (13824) 2021-03-09 17:33:10.076: INFO @metrics_hook: train gender_accuracy: 0.728 +-0.008 (13824) 2021-03-09 17:33:12.589: INFO @decay_lr : LR updated to `0.00026202598` 2021-03-09 17:33:12.591: INFO @log_profile : T train: 18.557639 2021-03-09 17:33:12.591: INFO @log_profile : T read data: 0.389291 2021-03-09 17:33:12.591: INFO @log_profile : T hooks: 2.972741 2021-03-09 17:33:12.591: INFO @main_loop : Epoch 27 done 2021-03-09 17:33:12.591: INFO @main_loop : Training epoch 28 2021-03-09 17:33:32.001: INFO @log_variables: train loss nanmean: 1.920978 2021-03-09 17:33:32.001: INFO @log_variables: train age_loss mean: 14.407435 2021-03-09 17:33:32.001: INFO @log_variables: train gender_loss mean: 0.535794 2021-03-09 17:33:32.001: INFO @log_variables: train age_mae mean: 13.645412 2021-03-09 17:33:32.002: INFO @log_variables: train gender_accuracy mean: 0.728733 2021-03-09 17:33:32.002: INFO @log_variables: train gender_confidence/loss nanmean: 0.078025 2021-03-09 17:33:32.002: INFO @log_variables: train gender_confidence/accuracy mean: 0.674986 2021-03-09 17:33:32.002: INFO @log_variables: train age_confidence/loss mean: 0.046101 2021-03-09 17:33:32.002: INFO @log_variables: train age_confidence/accuracy mean: 0.762659 2021-03-09 17:33:32.002: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:33:32.003: INFO @metrics_hook: train age_mae: 13.645 +-0.188 (13824) 2021-03-09 17:33:32.004: INFO @metrics_hook: train gender_accuracy: 0.729 +-0.008 (13824) 2021-03-09 17:33:34.509: INFO @decay_lr : LR updated to `0.00026071584` 2021-03-09 17:33:34.510: INFO @log_profile : T train: 18.534806 2021-03-09 17:33:34.510: INFO @log_profile : T read data: 0.341381 2021-03-09 17:33:34.511: INFO @log_profile : T hooks: 2.993576 2021-03-09 17:33:34.511: INFO @main_loop : Epoch 28 done 2021-03-09 17:33:34.511: INFO @main_loop : Training epoch 29 2021-03-09 17:33:54.190: INFO @log_variables: train loss nanmean: 1.917789 2021-03-09 17:33:54.191: INFO @log_variables: train age_loss mean: 14.485315 2021-03-09 17:33:54.191: INFO @log_variables: train gender_loss mean: 0.525796 2021-03-09 17:33:54.191: INFO @log_variables: train age_mae mean: 13.725822 2021-03-09 17:33:54.191: INFO @log_variables: train gender_accuracy mean: 0.731988 2021-03-09 17:33:54.191: INFO @log_variables: train gender_confidence/loss nanmean: 0.077118 2021-03-09 17:33:54.191: INFO @log_variables: train gender_confidence/accuracy mean: 0.682509 2021-03-09 17:33:54.191: INFO @log_variables: train age_confidence/loss mean: 0.045828 2021-03-09 17:33:54.191: INFO @log_variables: train age_confidence/accuracy mean: 0.762153 2021-03-09 17:33:54.191: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:33:54.193: INFO @metrics_hook: train age_mae: 13.726 +-0.192 (13824) 2021-03-09 17:33:54.194: INFO @metrics_hook: train gender_accuracy: 0.732 +-0.008 (13824) 2021-03-09 17:33:56.509: INFO @decay_lr : LR updated to `0.00025941225` 2021-03-09 17:33:56.510: INFO @log_profile : T train: 18.681824 2021-03-09 17:33:56.511: INFO @log_profile : T read data: 0.465911 2021-03-09 17:33:56.511: INFO @log_profile : T hooks: 2.798587 2021-03-09 17:33:56.511: INFO @main_loop : Epoch 29 done 2021-03-09 17:33:56.511: INFO @main_loop : Training epoch 30 2021-03-09 17:34:15.879: INFO @log_variables: train loss nanmean: 1.889872 2021-03-09 17:34:15.879: INFO @log_variables: train age_loss mean: 14.272617 2021-03-09 17:34:15.880: INFO @log_variables: train gender_loss mean: 0.515716 2021-03-09 17:34:15.880: INFO @log_variables: train age_mae mean: 13.519983 2021-03-09 17:34:15.880: INFO @log_variables: train gender_accuracy mean: 0.743616 2021-03-09 17:34:15.880: INFO @log_variables: train gender_confidence/loss nanmean: 0.077774 2021-03-09 17:34:15.880: INFO @log_variables: train gender_confidence/accuracy mean: 0.684005 2021-03-09 17:34:15.880: INFO @log_variables: train age_confidence/loss mean: 0.045754 2021-03-09 17:34:15.880: INFO @log_variables: train age_confidence/accuracy mean: 0.762280 2021-03-09 17:34:15.880: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:34:15.883: INFO @metrics_hook: train age_mae: 13.520 +-0.190 (13823) 2021-03-09 17:34:15.885: INFO @metrics_hook: train gender_accuracy: 0.744 +-0.007 (13823) 2021-03-09 17:34:18.326: INFO @decay_lr : LR updated to `0.00025811518` 2021-03-09 17:34:18.328: INFO @log_profile : T train: 18.506801 2021-03-09 17:34:18.328: INFO @log_profile : T read data: 0.306398 2021-03-09 17:34:18.328: INFO @log_profile : T hooks: 2.956389 2021-03-09 17:34:18.328: INFO @main_loop : Epoch 30 done 2021-03-09 17:34:18.328: INFO @main_loop : Training epoch 31 2021-03-09 17:34:37.164: INFO @log_variables: train loss nanmean: 1.875368 2021-03-09 17:34:37.165: INFO @log_variables: train age_loss mean: 14.147725 2021-03-09 17:34:37.165: INFO @log_variables: train gender_loss mean: 0.512206 2021-03-09 17:34:37.165: INFO @log_variables: train age_mae mean: 13.396005 2021-03-09 17:34:37.165: INFO @log_variables: train gender_accuracy mean: 0.744213 2021-03-09 17:34:37.165: INFO @log_variables: train gender_confidence/loss nanmean: 0.077419 2021-03-09 17:34:37.165: INFO @log_variables: train gender_confidence/accuracy mean: 0.689598 2021-03-09 17:34:37.165: INFO @log_variables: train age_confidence/loss mean: 0.046150 2021-03-09 17:34:37.165: INFO @log_variables: train age_confidence/accuracy mean: 0.762008 2021-03-09 17:34:37.165: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:34:37.167: INFO @metrics_hook: train age_mae: 13.396 +-0.186 (13824) 2021-03-09 17:34:37.169: INFO @metrics_hook: train gender_accuracy: 0.744 +-0.007 (13824) 2021-03-09 17:34:39.219: INFO @decay_lr : LR updated to `0.0002568246` 2021-03-09 17:34:39.220: INFO @log_profile : T train: 18.003415 2021-03-09 17:34:39.220: INFO @log_profile : T read data: 0.301108 2021-03-09 17:34:39.220: INFO @log_profile : T hooks: 2.538928 2021-03-09 17:34:39.220: INFO @main_loop : Epoch 31 done 2021-03-09 17:34:39.221: INFO @main_loop : Training epoch 32 2021-03-09 17:34:58.263: INFO @log_variables: train loss nanmean: 1.859151 2021-03-09 17:34:58.263: INFO @log_variables: train age_loss mean: 14.032882 2021-03-09 17:34:58.263: INFO @log_variables: train gender_loss mean: 0.504793 2021-03-09 17:34:58.263: INFO @log_variables: train age_mae mean: 13.288070 2021-03-09 17:34:58.263: INFO @log_variables: train gender_accuracy mean: 0.749060 2021-03-09 17:34:58.263: INFO @log_variables: train gender_confidence/loss nanmean: 0.077379 2021-03-09 17:34:58.263: INFO @log_variables: train gender_confidence/accuracy mean: 0.691117 2021-03-09 17:34:58.264: INFO @log_variables: train age_confidence/loss mean: 0.047152 2021-03-09 17:34:58.264: INFO @log_variables: train age_confidence/accuracy mean: 0.752387 2021-03-09 17:34:58.264: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:34:58.266: INFO @metrics_hook: train age_mae: 13.288 +-0.189 (13824) 2021-03-09 17:34:58.268: INFO @metrics_hook: train gender_accuracy: 0.749 +-0.007 (13824) 2021-03-09 17:35:00.294: INFO @decay_lr : LR updated to `0.00025554048` 2021-03-09 17:35:00.295: INFO @log_profile : T train: 18.052965 2021-03-09 17:35:00.295: INFO @log_profile : T read data: 0.428922 2021-03-09 17:35:00.295: INFO @log_profile : T hooks: 2.544149 2021-03-09 17:35:00.295: INFO @main_loop : Epoch 32 done 2021-03-09 17:35:00.295: INFO @main_loop : Training epoch 33 2021-03-09 17:35:19.194: INFO @log_variables: train loss nanmean: 1.840674 2021-03-09 17:35:19.195: INFO @log_variables: train age_loss mean: 13.894307 2021-03-09 17:35:19.195: INFO @log_variables: train gender_loss mean: 0.497076 2021-03-09 17:35:19.195: INFO @log_variables: train age_mae mean: 13.145988 2021-03-09 17:35:19.195: INFO @log_variables: train gender_accuracy mean: 0.758753 2021-03-09 17:35:19.195: INFO @log_variables: train gender_confidence/loss nanmean: 0.077873 2021-03-09 17:35:19.195: INFO @log_variables: train gender_confidence/accuracy mean: 0.695964 2021-03-09 17:35:19.195: INFO @log_variables: train age_confidence/loss mean: 0.047795 2021-03-09 17:35:19.195: INFO @log_variables: train age_confidence/accuracy mean: 0.746600 2021-03-09 17:35:19.195: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:35:19.196: INFO @metrics_hook: train age_mae: 13.146 +-0.188 (13824) 2021-03-09 17:35:19.198: INFO @metrics_hook: train gender_accuracy: 0.759 +-0.007 (13824) 2021-03-09 17:35:21.311: INFO @decay_lr : LR updated to `0.00025426276` 2021-03-09 17:35:21.312: INFO @log_profile : T train: 17.970626 2021-03-09 17:35:21.312: INFO @log_profile : T read data: 0.314667 2021-03-09 17:35:21.312: INFO @log_profile : T hooks: 2.682334 2021-03-09 17:35:21.313: INFO @main_loop : Epoch 33 done 2021-03-09 17:35:21.313: INFO @main_loop : Training epoch 34 2021-03-09 17:35:39.443: INFO @log_variables: train loss nanmean: 1.851455 2021-03-09 17:35:39.444: INFO @log_variables: train age_loss mean: 14.009558 2021-03-09 17:35:39.445: INFO @log_variables: train gender_loss mean: 0.498869 2021-03-09 17:35:39.446: INFO @log_variables: train age_mae mean: 13.265693 2021-03-09 17:35:39.447: INFO @log_variables: train gender_accuracy mean: 0.755715 2021-03-09 17:35:39.447: INFO @log_variables: train gender_confidence/loss nanmean: 0.077618 2021-03-09 17:35:39.447: INFO @log_variables: train gender_confidence/accuracy mean: 0.691262 2021-03-09 17:35:39.448: INFO @log_variables: train age_confidence/loss mean: 0.046723 2021-03-09 17:35:39.448: INFO @log_variables: train age_confidence/accuracy mean: 0.755353 2021-03-09 17:35:39.448: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:35:39.450: INFO @metrics_hook: train age_mae: 13.266 +-0.188 (13824) 2021-03-09 17:35:39.451: INFO @metrics_hook: train gender_accuracy: 0.756 +-0.007 (13824) 2021-03-09 17:35:41.746: INFO @decay_lr : LR updated to `0.00025299145` 2021-03-09 17:35:41.747: INFO @log_profile : T train: 17.275267 2021-03-09 17:35:41.747: INFO @log_profile : T read data: 0.330345 2021-03-09 17:35:41.747: INFO @log_profile : T hooks: 2.778667 2021-03-09 17:35:41.748: INFO @main_loop : Epoch 34 done 2021-03-09 17:35:41.748: INFO @main_loop : Training epoch 35 2021-03-09 17:36:00.424: INFO @log_variables: train loss nanmean: 1.832823 2021-03-09 17:36:00.424: INFO @log_variables: train age_loss mean: 13.804769 2021-03-09 17:36:00.424: INFO @log_variables: train gender_loss mean: 0.498531 2021-03-09 17:36:00.424: INFO @log_variables: train age_mae mean: 13.062209 2021-03-09 17:36:00.424: INFO @log_variables: train gender_accuracy mean: 0.754702 2021-03-09 17:36:00.424: INFO @log_variables: train gender_confidence/loss nanmean: 0.077187 2021-03-09 17:36:00.424: INFO @log_variables: train gender_confidence/accuracy mean: 0.696687 2021-03-09 17:36:00.425: INFO @log_variables: train age_confidence/loss mean: 0.047447 2021-03-09 17:36:00.425: INFO @log_variables: train age_confidence/accuracy mean: 0.749060 2021-03-09 17:36:00.425: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:36:00.426: INFO @metrics_hook: train age_mae: 13.062 +-0.184 (13824) 2021-03-09 17:36:00.427: INFO @metrics_hook: train gender_accuracy: 0.755 +-0.007 (13824) 2021-03-09 17:36:02.549: INFO @decay_lr : LR updated to `0.00025172648` 2021-03-09 17:36:02.551: INFO @log_profile : T train: 17.800307 2021-03-09 17:36:02.551: INFO @log_profile : T read data: 0.362071 2021-03-09 17:36:02.551: INFO @log_profile : T hooks: 2.584291 2021-03-09 17:36:02.551: INFO @main_loop : Epoch 35 done 2021-03-09 17:36:02.551: INFO @main_loop : Training epoch 36 2021-03-09 17:36:22.735: INFO @log_variables: train loss nanmean: 1.835350 2021-03-09 17:36:22.737: INFO @log_variables: train age_loss mean: 13.954329 2021-03-09 17:36:22.737: INFO @log_variables: train gender_loss mean: 0.486815 2021-03-09 17:36:22.737: INFO @log_variables: train age_mae mean: 13.216991 2021-03-09 17:36:22.737: INFO @log_variables: train gender_accuracy mean: 0.763527 2021-03-09 17:36:22.737: INFO @log_variables: train gender_confidence/loss nanmean: 0.077426 2021-03-09 17:36:22.738: INFO @log_variables: train gender_confidence/accuracy mean: 0.696976 2021-03-09 17:36:22.738: INFO @log_variables: train age_confidence/loss mean: 0.046789 2021-03-09 17:36:22.738: INFO @log_variables: train age_confidence/accuracy mean: 0.757523 2021-03-09 17:36:22.738: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:36:22.741: INFO @metrics_hook: train age_mae: 13.217 +-0.189 (13824) 2021-03-09 17:36:22.743: INFO @metrics_hook: train gender_accuracy: 0.764 +-0.007 (13824) 2021-03-09 17:36:25.973: INFO @decay_lr : LR updated to `0.00025046786` 2021-03-09 17:36:25.979: INFO @log_profile : T train: 19.063663 2021-03-09 17:36:25.980: INFO @log_profile : T read data: 0.577374 2021-03-09 17:36:25.980: INFO @log_profile : T hooks: 3.733764 2021-03-09 17:36:25.982: INFO @main_loop : Epoch 36 done 2021-03-09 17:36:25.982: INFO @main_loop : Training epoch 37 2021-03-09 17:36:46.932: INFO @log_variables: train loss nanmean: 1.800149 2021-03-09 17:36:46.932: INFO @log_variables: train age_loss mean: 13.576344 2021-03-09 17:36:46.932: INFO @log_variables: train gender_loss mean: 0.485332 2021-03-09 17:36:46.932: INFO @log_variables: train age_mae mean: 12.838614 2021-03-09 17:36:46.932: INFO @log_variables: train gender_accuracy mean: 0.761936 2021-03-09 17:36:46.932: INFO @log_variables: train gender_confidence/loss nanmean: 0.076710 2021-03-09 17:36:46.932: INFO @log_variables: train gender_confidence/accuracy mean: 0.701751 2021-03-09 17:36:46.932: INFO @log_variables: train age_confidence/loss mean: 0.048015 2021-03-09 17:36:46.932: INFO @log_variables: train age_confidence/accuracy mean: 0.744936 2021-03-09 17:36:46.932: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:36:46.934: INFO @metrics_hook: train age_mae: 12.839 +-0.185 (13824) 2021-03-09 17:36:46.936: INFO @metrics_hook: train gender_accuracy: 0.762 +-0.007 (13824) 2021-03-09 17:36:49.727: INFO @decay_lr : LR updated to `0.00024921552` 2021-03-09 17:36:49.728: INFO @log_profile : T train: 19.816955 2021-03-09 17:36:49.728: INFO @log_profile : T read data: 0.568190 2021-03-09 17:36:49.729: INFO @log_profile : T hooks: 3.296106 2021-03-09 17:36:49.729: INFO @main_loop : Epoch 37 done 2021-03-09 17:36:49.729: INFO @main_loop : Training epoch 38 2021-03-09 17:37:08.644: INFO @log_variables: train loss nanmean: 1.808459 2021-03-09 17:37:08.644: INFO @log_variables: train age_loss mean: 13.641737 2021-03-09 17:37:08.644: INFO @log_variables: train gender_loss mean: 0.487949 2021-03-09 17:37:08.644: INFO @log_variables: train age_mae mean: 12.907686 2021-03-09 17:37:08.645: INFO @log_variables: train gender_accuracy mean: 0.759332 2021-03-09 17:37:08.645: INFO @log_variables: train gender_confidence/loss nanmean: 0.076856 2021-03-09 17:37:08.645: INFO @log_variables: train gender_confidence/accuracy mean: 0.693359 2021-03-09 17:37:08.645: INFO @log_variables: train age_confidence/loss mean: 0.047854 2021-03-09 17:37:08.645: INFO @log_variables: train age_confidence/accuracy mean: 0.747034 2021-03-09 17:37:08.645: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:37:08.647: INFO @metrics_hook: train age_mae: 12.908 +-0.187 (13824) 2021-03-09 17:37:08.648: INFO @metrics_hook: train gender_accuracy: 0.759 +-0.007 (13824) 2021-03-09 17:37:10.896: INFO @decay_lr : LR updated to `0.00024796944` 2021-03-09 17:37:10.898: INFO @log_profile : T train: 18.006505 2021-03-09 17:37:10.898: INFO @log_profile : T read data: 0.383395 2021-03-09 17:37:10.898: INFO @log_profile : T hooks: 2.727958 2021-03-09 17:37:10.898: INFO @main_loop : Epoch 38 done 2021-03-09 17:37:10.898: INFO @main_loop : Training epoch 39 2021-03-09 17:37:30.324: INFO @log_variables: train loss nanmean: 1.791297 2021-03-09 17:37:30.324: INFO @log_variables: train age_loss mean: 13.459080 2021-03-09 17:37:30.325: INFO @log_variables: train gender_loss mean: 0.486892 2021-03-09 17:37:30.325: INFO @log_variables: train age_mae mean: 12.728004 2021-03-09 17:37:30.325: INFO @log_variables: train gender_accuracy mean: 0.762514 2021-03-09 17:37:30.325: INFO @log_variables: train gender_confidence/loss nanmean: 0.076931 2021-03-09 17:37:30.325: INFO @log_variables: train gender_confidence/accuracy mean: 0.695312 2021-03-09 17:37:30.325: INFO @log_variables: train age_confidence/loss mean: 0.048185 2021-03-09 17:37:30.325: INFO @log_variables: train age_confidence/accuracy mean: 0.740958 2021-03-09 17:37:30.325: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:37:30.326: INFO @metrics_hook: train age_mae: 12.728 +-0.182 (13824) 2021-03-09 17:37:30.328: INFO @metrics_hook: train gender_accuracy: 0.763 +-0.007 (13824) 2021-03-09 17:37:33.006: INFO @decay_lr : LR updated to `0.00024672959` 2021-03-09 17:37:33.007: INFO @log_profile : T train: 18.350061 2021-03-09 17:37:33.007: INFO @log_profile : T read data: 0.489141 2021-03-09 17:37:33.007: INFO @log_profile : T hooks: 3.217441 2021-03-09 17:37:33.008: INFO @main_loop : Epoch 39 done 2021-03-09 17:37:33.008: INFO @main_loop : Training epoch 40 2021-03-09 17:37:53.731: INFO @log_variables: train loss nanmean: 1.789076 2021-03-09 17:37:53.731: INFO @log_variables: train age_loss mean: 13.616899 2021-03-09 17:37:53.731: INFO @log_variables: train gender_loss mean: 0.468687 2021-03-09 17:37:53.731: INFO @log_variables: train age_mae mean: 12.885114 2021-03-09 17:37:53.731: INFO @log_variables: train gender_accuracy mean: 0.775608 2021-03-09 17:37:53.731: INFO @log_variables: train gender_confidence/loss nanmean: 0.077122 2021-03-09 17:37:53.731: INFO @log_variables: train gender_confidence/accuracy mean: 0.706814 2021-03-09 17:37:53.732: INFO @log_variables: train age_confidence/loss mean: 0.047975 2021-03-09 17:37:53.732: INFO @log_variables: train age_confidence/accuracy mean: 0.743417 2021-03-09 17:37:53.732: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:37:53.735: INFO @metrics_hook: train age_mae: 12.885 +-0.186 (13824) 2021-03-09 17:37:53.741: INFO @metrics_hook: train gender_accuracy: 0.776 +-0.007 (13824) 2021-03-09 17:37:57.489: INFO @decay_lr : LR updated to `0.00024549593` 2021-03-09 17:37:57.493: INFO @log_profile : T train: 19.667416 2021-03-09 17:37:57.494: INFO @log_profile : T read data: 0.504080 2021-03-09 17:37:57.495: INFO @log_profile : T hooks: 4.250522 2021-03-09 17:37:57.496: INFO @main_loop : Epoch 40 done 2021-03-09 17:37:57.496: INFO @main_loop : Training epoch 41 2021-03-09 17:38:18.560: INFO @log_variables: train loss nanmean: 1.776270 2021-03-09 17:38:18.560: INFO @log_variables: train age_loss mean: 13.454529 2021-03-09 17:38:18.561: INFO @log_variables: train gender_loss mean: 0.469863 2021-03-09 17:38:18.561: INFO @log_variables: train age_mae mean: 12.726021 2021-03-09 17:38:18.561: INFO @log_variables: train gender_accuracy mean: 0.777762 2021-03-09 17:38:18.561: INFO @log_variables: train gender_confidence/loss nanmean: 0.077453 2021-03-09 17:38:18.561: INFO @log_variables: train gender_confidence/accuracy mean: 0.705636 2021-03-09 17:38:18.561: INFO @log_variables: train age_confidence/loss mean: 0.048530 2021-03-09 17:38:18.561: INFO @log_variables: train age_confidence/accuracy mean: 0.740722 2021-03-09 17:38:18.561: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:38:18.563: INFO @metrics_hook: train age_mae: 12.726 +-0.186 (13823) 2021-03-09 17:38:18.565: INFO @metrics_hook: train gender_accuracy: 0.778 +-0.007 (13823) 2021-03-09 17:38:21.539: INFO @decay_lr : LR updated to `0.00024426845` 2021-03-09 17:38:21.541: INFO @log_profile : T train: 20.033855 2021-03-09 17:38:21.541: INFO @log_profile : T read data: 0.463812 2021-03-09 17:38:21.541: INFO @log_profile : T hooks: 3.491439 2021-03-09 17:38:21.541: INFO @main_loop : Epoch 41 done 2021-03-09 17:38:21.541: INFO @main_loop : Training epoch 42 2021-03-09 17:38:42.348: INFO @log_variables: train loss nanmean: 1.759244 2021-03-09 17:38:42.348: INFO @log_variables: train age_loss mean: 13.332053 2021-03-09 17:38:42.348: INFO @log_variables: train gender_loss mean: 0.465689 2021-03-09 17:38:42.348: INFO @log_variables: train age_mae mean: 12.606322 2021-03-09 17:38:42.348: INFO @log_variables: train gender_accuracy mean: 0.774289 2021-03-09 17:38:42.348: INFO @log_variables: train gender_confidence/loss nanmean: 0.076375 2021-03-09 17:38:42.348: INFO @log_variables: train gender_confidence/accuracy mean: 0.708963 2021-03-09 17:38:42.349: INFO @log_variables: train age_confidence/loss mean: 0.047511 2021-03-09 17:38:42.349: INFO @log_variables: train age_confidence/accuracy mean: 0.748246 2021-03-09 17:38:42.349: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:38:42.351: INFO @metrics_hook: train age_mae: 12.606 +-0.183 (13823) 2021-03-09 17:38:42.352: INFO @metrics_hook: train gender_accuracy: 0.774 +-0.007 (13823) 2021-03-09 17:38:45.317: INFO @decay_lr : LR updated to `0.0002430471` 2021-03-09 17:38:45.318: INFO @log_profile : T train: 19.664365 2021-03-09 17:38:45.318: INFO @log_profile : T read data: 0.591009 2021-03-09 17:38:45.319: INFO @log_profile : T hooks: 3.461456 2021-03-09 17:38:45.319: INFO @main_loop : Epoch 42 done 2021-03-09 17:38:45.319: INFO @main_loop : Training epoch 43 2021-03-09 17:39:06.693: INFO @log_variables: train loss nanmean: 1.734619 2021-03-09 17:39:06.693: INFO @log_variables: train age_loss mean: 13.056583 2021-03-09 17:39:06.693: INFO @log_variables: train gender_loss mean: 0.464076 2021-03-09 17:39:06.694: INFO @log_variables: train age_mae mean: 12.332880 2021-03-09 17:39:06.694: INFO @log_variables: train gender_accuracy mean: 0.777834 2021-03-09 17:39:06.694: INFO @log_variables: train gender_confidence/loss nanmean: 0.076820 2021-03-09 17:39:06.694: INFO @log_variables: train gender_confidence/accuracy mean: 0.704333 2021-03-09 17:39:06.694: INFO @log_variables: train age_confidence/loss mean: 0.048950 2021-03-09 17:39:06.694: INFO @log_variables: train age_confidence/accuracy mean: 0.737032 2021-03-09 17:39:06.694: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:39:06.696: INFO @metrics_hook: train age_mae: 12.333 +-0.181 (13823) 2021-03-09 17:39:06.698: INFO @metrics_hook: train gender_accuracy: 0.778 +-0.007 (13823) 2021-03-09 17:39:10.453: INFO @decay_lr : LR updated to `0.00024183188` 2021-03-09 17:39:10.454: INFO @log_profile : T train: 20.351199 2021-03-09 17:39:10.454: INFO @log_profile : T read data: 0.467388 2021-03-09 17:39:10.454: INFO @log_profile : T hooks: 4.265074 2021-03-09 17:39:10.455: INFO @main_loop : Epoch 43 done 2021-03-09 17:39:10.455: INFO @main_loop : Training epoch 44 2021-03-09 17:39:31.483: INFO @log_variables: train loss nanmean: 1.735818 2021-03-09 17:39:31.484: INFO @log_variables: train age_loss mean: 13.132740 2021-03-09 17:39:31.484: INFO @log_variables: train gender_loss mean: 0.457952 2021-03-09 17:39:31.484: INFO @log_variables: train age_mae mean: 12.408154 2021-03-09 17:39:31.484: INFO @log_variables: train gender_accuracy mean: 0.781033 2021-03-09 17:39:31.484: INFO @log_variables: train gender_confidence/loss nanmean: 0.076155 2021-03-09 17:39:31.484: INFO @log_variables: train gender_confidence/accuracy mean: 0.706887 2021-03-09 17:39:31.484: INFO @log_variables: train age_confidence/loss mean: 0.049458 2021-03-09 17:39:31.484: INFO @log_variables: train age_confidence/accuracy mean: 0.731264 2021-03-09 17:39:31.484: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:39:31.487: INFO @metrics_hook: train age_mae: 12.408 +-0.183 (13824) 2021-03-09 17:39:31.488: INFO @metrics_hook: train gender_accuracy: 0.781 +-0.007 (13824) 2021-03-09 17:39:34.328: INFO @decay_lr : LR updated to `0.00024062271` 2021-03-09 17:39:34.329: INFO @log_profile : T train: 19.987511 2021-03-09 17:39:34.329: INFO @log_profile : T read data: 0.481999 2021-03-09 17:39:34.330: INFO @log_profile : T hooks: 3.346767 2021-03-09 17:39:34.330: INFO @main_loop : Epoch 44 done 2021-03-09 17:39:34.330: INFO @main_loop : Training epoch 45 2021-03-09 17:39:55.395: INFO @log_variables: train loss nanmean: 1.732670 2021-03-09 17:39:55.395: INFO @log_variables: train age_loss mean: 13.095066 2021-03-09 17:39:55.395: INFO @log_variables: train gender_loss mean: 0.459483 2021-03-09 17:39:55.395: INFO @log_variables: train age_mae mean: 12.372106 2021-03-09 17:39:55.395: INFO @log_variables: train gender_accuracy mean: 0.775535 2021-03-09 17:39:55.395: INFO @log_variables: train gender_confidence/loss nanmean: 0.075622 2021-03-09 17:39:55.395: INFO @log_variables: train gender_confidence/accuracy mean: 0.713831 2021-03-09 17:39:55.395: INFO @log_variables: train age_confidence/loss mean: 0.048875 2021-03-09 17:39:55.395: INFO @log_variables: train age_confidence/accuracy mean: 0.737775 2021-03-09 17:39:55.395: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:39:55.397: INFO @metrics_hook: train age_mae: 12.372 +-0.183 (13824) 2021-03-09 17:39:55.398: INFO @metrics_hook: train gender_accuracy: 0.776 +-0.007 (13824) 2021-03-09 17:39:58.395: INFO @decay_lr : LR updated to `0.0002394196` 2021-03-09 17:39:58.396: INFO @log_profile : T train: 19.749812 2021-03-09 17:39:58.396: INFO @log_profile : T read data: 0.710629 2021-03-09 17:39:58.396: INFO @log_profile : T hooks: 3.521345 2021-03-09 17:39:58.396: INFO @main_loop : Epoch 45 done 2021-03-09 17:39:58.396: INFO @main_loop : Training epoch 46 2021-03-09 17:40:18.576: INFO @log_variables: train loss nanmean: 1.730899 2021-03-09 17:40:18.576: INFO @log_variables: train age_loss mean: 13.155922 2021-03-09 17:40:18.576: INFO @log_variables: train gender_loss mean: 0.449611 2021-03-09 17:40:18.577: INFO @log_variables: train age_mae mean: 12.435358 2021-03-09 17:40:18.577: INFO @log_variables: train gender_accuracy mean: 0.788773 2021-03-09 17:40:18.577: INFO @log_variables: train gender_confidence/loss nanmean: 0.076592 2021-03-09 17:40:18.577: INFO @log_variables: train gender_confidence/accuracy mean: 0.714482 2021-03-09 17:40:18.577: INFO @log_variables: train age_confidence/loss mean: 0.049576 2021-03-09 17:40:18.577: INFO @log_variables: train age_confidence/accuracy mean: 0.726707 2021-03-09 17:40:18.577: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:40:18.579: INFO @metrics_hook: train age_mae: 12.435 +-0.185 (13824) 2021-03-09 17:40:18.580: INFO @metrics_hook: train gender_accuracy: 0.789 +-0.007 (13824) 2021-03-09 17:40:21.482: INFO @decay_lr : LR updated to `0.0002382225` 2021-03-09 17:40:21.486: INFO @log_profile : T train: 19.162726 2021-03-09 17:40:21.486: INFO @log_profile : T read data: 0.482324 2021-03-09 17:40:21.487: INFO @log_profile : T hooks: 3.391224 2021-03-09 17:40:21.487: INFO @main_loop : Epoch 46 done 2021-03-09 17:40:21.488: INFO @main_loop : Training epoch 47 2021-03-09 17:40:42.323: INFO @log_variables: train loss nanmean: 1.709614 2021-03-09 17:40:42.323: INFO @log_variables: train age_loss mean: 12.896562 2021-03-09 17:40:42.324: INFO @log_variables: train gender_loss mean: 0.453548 2021-03-09 17:40:42.324: INFO @log_variables: train age_mae mean: 12.182045 2021-03-09 17:40:42.324: INFO @log_variables: train gender_accuracy mean: 0.780454 2021-03-09 17:40:42.324: INFO @log_variables: train gender_confidence/loss nanmean: 0.075542 2021-03-09 17:40:42.324: INFO @log_variables: train gender_confidence/accuracy mean: 0.715133 2021-03-09 17:40:42.324: INFO @log_variables: train age_confidence/loss mean: 0.049342 2021-03-09 17:40:42.324: INFO @log_variables: train age_confidence/accuracy mean: 0.733073 2021-03-09 17:40:42.324: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:40:42.326: INFO @metrics_hook: train age_mae: 12.182 +-0.178 (13824) 2021-03-09 17:40:42.328: INFO @metrics_hook: train gender_accuracy: 0.780 +-0.007 (13824) 2021-03-09 17:40:45.005: INFO @decay_lr : LR updated to `0.00023703139` 2021-03-09 17:40:45.007: INFO @log_profile : T train: 19.846177 2021-03-09 17:40:45.007: INFO @log_profile : T read data: 0.460621 2021-03-09 17:40:45.007: INFO @log_profile : T hooks: 3.159927 2021-03-09 17:40:45.007: INFO @main_loop : Epoch 47 done 2021-03-09 17:40:45.008: INFO @main_loop : Training epoch 48 2021-03-09 17:41:04.559: INFO @log_variables: train loss nanmean: 1.724123 2021-03-09 17:41:04.559: INFO @log_variables: train age_loss mean: 13.067452 2021-03-09 17:41:04.559: INFO @log_variables: train gender_loss mean: 0.452473 2021-03-09 17:41:04.559: INFO @log_variables: train age_mae mean: 12.351909 2021-03-09 17:41:04.559: INFO @log_variables: train gender_accuracy mean: 0.785084 2021-03-09 17:41:04.559: INFO @log_variables: train gender_confidence/loss nanmean: 0.076081 2021-03-09 17:41:04.560: INFO @log_variables: train gender_confidence/accuracy mean: 0.709997 2021-03-09 17:41:04.560: INFO @log_variables: train age_confidence/loss mean: 0.048753 2021-03-09 17:41:04.560: INFO @log_variables: train age_confidence/accuracy mean: 0.737486 2021-03-09 17:41:04.560: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:41:04.562: INFO @metrics_hook: train age_mae: 12.352 +-0.180 (13824) 2021-03-09 17:41:04.564: INFO @metrics_hook: train gender_accuracy: 0.785 +-0.007 (13824) 2021-03-09 17:41:06.671: INFO @decay_lr : LR updated to `0.00023584624` 2021-03-09 17:41:06.672: INFO @log_profile : T train: 18.515209 2021-03-09 17:41:06.672: INFO @log_profile : T read data: 0.481179 2021-03-09 17:41:06.672: INFO @log_profile : T hooks: 2.615182 2021-03-09 17:41:06.672: INFO @main_loop : Epoch 48 done 2021-03-09 17:41:06.672: INFO @main_loop : Training epoch 49 2021-03-09 17:41:25.652: INFO @log_variables: train loss nanmean: 1.701463 2021-03-09 17:41:25.653: INFO @log_variables: train age_loss mean: 12.836478 2021-03-09 17:41:25.653: INFO @log_variables: train gender_loss mean: 0.448356 2021-03-09 17:41:25.653: INFO @log_variables: train age_mae mean: 12.123590 2021-03-09 17:41:25.653: INFO @log_variables: train gender_accuracy mean: 0.793113 2021-03-09 17:41:25.653: INFO @log_variables: train gender_confidence/loss nanmean: 0.077433 2021-03-09 17:41:25.653: INFO @log_variables: train gender_confidence/accuracy mean: 0.708478 2021-03-09 17:41:25.653: INFO @log_variables: train age_confidence/loss mean: 0.049481 2021-03-09 17:41:25.653: INFO @log_variables: train age_confidence/accuracy mean: 0.729528 2021-03-09 17:41:25.653: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:41:25.655: INFO @metrics_hook: train age_mae: 12.124 +-0.181 (13824) 2021-03-09 17:41:25.657: INFO @metrics_hook: train gender_accuracy: 0.793 +-0.007 (13824) 2021-03-09 17:41:27.769: INFO @decay_lr : LR updated to `0.00023466701` 2021-03-09 17:41:27.770: INFO @log_profile : T train: 18.116600 2021-03-09 17:41:27.770: INFO @log_profile : T read data: 0.307763 2021-03-09 17:41:27.770: INFO @log_profile : T hooks: 2.623543 2021-03-09 17:41:27.770: INFO @main_loop : Epoch 49 done 2021-03-09 17:41:27.770: INFO @main_loop : Training epoch 50 2021-03-09 17:41:46.617: INFO @log_variables: train loss nanmean: 1.690822 2021-03-09 17:41:46.617: INFO @log_variables: train age_loss mean: 12.755309 2021-03-09 17:41:46.617: INFO @log_variables: train gender_loss mean: 0.446085 2021-03-09 17:41:46.617: INFO @log_variables: train age_mae mean: 12.046118 2021-03-09 17:41:46.617: INFO @log_variables: train gender_accuracy mean: 0.786892 2021-03-09 17:41:46.617: INFO @log_variables: train gender_confidence/loss nanmean: 0.076100 2021-03-09 17:41:46.618: INFO @log_variables: train gender_confidence/accuracy mean: 0.705223 2021-03-09 17:41:46.618: INFO @log_variables: train age_confidence/loss mean: 0.049616 2021-03-09 17:41:46.618: INFO @log_variables: train age_confidence/accuracy mean: 0.728877 2021-03-09 17:41:46.618: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:41:46.620: INFO @metrics_hook: train age_mae: 12.046 +-0.180 (13824) 2021-03-09 17:41:46.622: INFO @metrics_hook: train gender_accuracy: 0.787 +-0.007 (13824) 2021-03-09 17:41:48.621: INFO @decay_lr : LR updated to `0.00023349367` 2021-03-09 17:41:48.622: INFO @log_profile : T train: 17.980845 2021-03-09 17:41:48.622: INFO @log_profile : T read data: 0.318031 2021-03-09 17:41:48.622: INFO @log_profile : T hooks: 2.503726 2021-03-09 17:41:48.622: INFO @main_loop : Epoch 50 done 2021-03-09 17:41:48.622: INFO @main_loop : Training epoch 51 2021-03-09 17:42:07.604: INFO @log_variables: train loss nanmean: 1.690153 2021-03-09 17:42:07.604: INFO @log_variables: train age_loss mean: 12.801575 2021-03-09 17:42:07.604: INFO @log_variables: train gender_loss mean: 0.440441 2021-03-09 17:42:07.604: INFO @log_variables: train age_mae mean: 12.091533 2021-03-09 17:42:07.604: INFO @log_variables: train gender_accuracy mean: 0.792824 2021-03-09 17:42:07.604: INFO @log_variables: train gender_confidence/loss nanmean: 0.076548 2021-03-09 17:42:07.604: INFO @log_variables: train gender_confidence/accuracy mean: 0.715639 2021-03-09 17:42:07.604: INFO @log_variables: train age_confidence/loss mean: 0.049425 2021-03-09 17:42:07.604: INFO @log_variables: train age_confidence/accuracy mean: 0.731843 2021-03-09 17:42:07.604: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:42:07.606: INFO @metrics_hook: train age_mae: 12.092 +-0.180 (13824) 2021-03-09 17:42:07.607: INFO @metrics_hook: train gender_accuracy: 0.793 +-0.007 (13824) 2021-03-09 17:42:09.677: INFO @decay_lr : LR updated to `0.0002323262` 2021-03-09 17:42:09.679: INFO @log_profile : T train: 18.127983 2021-03-09 17:42:09.679: INFO @log_profile : T read data: 0.307770 2021-03-09 17:42:09.679: INFO @log_profile : T hooks: 2.570282 2021-03-09 17:42:09.679: INFO @main_loop : Epoch 51 done 2021-03-09 17:42:09.679: INFO @main_loop : Training epoch 52 2021-03-09 17:42:29.309: INFO @log_variables: train loss nanmean: 1.682576 2021-03-09 17:42:29.309: INFO @log_variables: train age_loss mean: 12.780829 2021-03-09 17:42:29.309: INFO @log_variables: train gender_loss mean: 0.435269 2021-03-09 17:42:29.309: INFO @log_variables: train age_mae mean: 12.071015 2021-03-09 17:42:29.309: INFO @log_variables: train gender_accuracy mean: 0.795211 2021-03-09 17:42:29.309: INFO @log_variables: train gender_confidence/loss nanmean: 0.075210 2021-03-09 17:42:29.309: INFO @log_variables: train gender_confidence/accuracy mean: 0.716435 2021-03-09 17:42:29.310: INFO @log_variables: train age_confidence/loss mean: 0.049773 2021-03-09 17:42:29.310: INFO @log_variables: train age_confidence/accuracy mean: 0.724609 2021-03-09 17:42:29.310: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:42:29.311: INFO @metrics_hook: train age_mae: 12.071 +-0.181 (13824) 2021-03-09 17:42:29.313: INFO @metrics_hook: train gender_accuracy: 0.795 +-0.007 (13824) 2021-03-09 17:42:31.667: INFO @decay_lr : LR updated to `0.00023116457` 2021-03-09 17:42:31.668: INFO @log_profile : T train: 18.623579 2021-03-09 17:42:31.669: INFO @log_profile : T read data: 0.494058 2021-03-09 17:42:31.669: INFO @log_profile : T hooks: 2.819039 2021-03-09 17:42:31.669: INFO @main_loop : Epoch 52 done 2021-03-09 17:42:31.669: INFO @main_loop : Training epoch 53 2021-03-09 17:42:50.780: INFO @log_variables: train loss nanmean: 1.655436 2021-03-09 17:42:50.781: INFO @log_variables: train age_loss mean: 12.545938 2021-03-09 17:42:50.781: INFO @log_variables: train gender_loss mean: 0.427114 2021-03-09 17:42:50.781: INFO @log_variables: train age_mae mean: 11.840269 2021-03-09 17:42:50.781: INFO @log_variables: train gender_accuracy mean: 0.799624 2021-03-09 17:42:50.781: INFO @log_variables: train gender_confidence/loss nanmean: 0.076176 2021-03-09 17:42:50.781: INFO @log_variables: train gender_confidence/accuracy mean: 0.714699 2021-03-09 17:42:50.781: INFO @log_variables: train age_confidence/loss mean: 0.050434 2021-03-09 17:42:50.781: INFO @log_variables: train age_confidence/accuracy mean: 0.725477 2021-03-09 17:42:50.781: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:42:50.783: INFO @metrics_hook: train age_mae: 11.840 +-0.178 (13824) 2021-03-09 17:42:50.785: INFO @metrics_hook: train gender_accuracy: 0.800 +-0.007 (13824) 2021-03-09 17:42:54.036: INFO @decay_lr : LR updated to `0.00023000874` 2021-03-09 17:42:54.038: INFO @log_profile : T train: 18.194543 2021-03-09 17:42:54.038: INFO @log_profile : T read data: 0.374648 2021-03-09 17:42:54.038: INFO @log_profile : T hooks: 3.748014 2021-03-09 17:42:54.038: INFO @main_loop : Epoch 53 done 2021-03-09 17:42:54.039: INFO @main_loop : Training epoch 54 2021-03-09 17:43:13.479: INFO @log_variables: train loss nanmean: 1.664283 2021-03-09 17:43:13.479: INFO @log_variables: train age_loss mean: 12.560328 2021-03-09 17:43:13.479: INFO @log_variables: train gender_loss mean: 0.436512 2021-03-09 17:43:13.479: INFO @log_variables: train age_mae mean: 11.859960 2021-03-09 17:43:13.479: INFO @log_variables: train gender_accuracy mean: 0.795356 2021-03-09 17:43:13.479: INFO @log_variables: train gender_confidence/loss nanmean: 0.075911 2021-03-09 17:43:13.479: INFO @log_variables: train gender_confidence/accuracy mean: 0.719329 2021-03-09 17:43:13.479: INFO @log_variables: train age_confidence/loss mean: 0.049695 2021-03-09 17:43:13.479: INFO @log_variables: train age_confidence/accuracy mean: 0.725477 2021-03-09 17:43:13.479: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:43:13.481: INFO @metrics_hook: train age_mae: 11.860 +-0.179 (13824) 2021-03-09 17:43:13.482: INFO @metrics_hook: train gender_accuracy: 0.795 +-0.007 (13824) 2021-03-09 17:43:15.832: INFO @decay_lr : LR updated to `0.0002288587` 2021-03-09 17:43:15.834: INFO @log_profile : T train: 18.512237 2021-03-09 17:43:15.834: INFO @log_profile : T read data: 0.408810 2021-03-09 17:43:15.834: INFO @log_profile : T hooks: 2.821460 2021-03-09 17:43:15.834: INFO @main_loop : Epoch 54 done 2021-03-09 17:43:15.835: INFO @main_loop : Training epoch 55 2021-03-09 17:43:34.608: INFO @log_variables: train loss nanmean: 1.656855 2021-03-09 17:43:34.609: INFO @log_variables: train age_loss mean: 12.582939 2021-03-09 17:43:34.609: INFO @log_variables: train gender_loss mean: 0.425760 2021-03-09 17:43:34.609: INFO @log_variables: train age_mae mean: 11.887738 2021-03-09 17:43:34.609: INFO @log_variables: train gender_accuracy mean: 0.804688 2021-03-09 17:43:34.609: INFO @log_variables: train gender_confidence/loss nanmean: 0.076113 2021-03-09 17:43:34.609: INFO @log_variables: train gender_confidence/accuracy mean: 0.717014 2021-03-09 17:43:34.609: INFO @log_variables: train age_confidence/loss mean: 0.049784 2021-03-09 17:43:34.609: INFO @log_variables: train age_confidence/accuracy mean: 0.729311 2021-03-09 17:43:34.609: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:43:34.611: INFO @metrics_hook: train age_mae: 11.888 +-0.178 (13824) 2021-03-09 17:43:34.613: INFO @metrics_hook: train gender_accuracy: 0.805 +-0.007 (13824) 2021-03-09 17:43:36.675: INFO @decay_lr : LR updated to `0.00022771441` 2021-03-09 17:43:36.676: INFO @log_profile : T train: 17.771176 2021-03-09 17:43:36.676: INFO @log_profile : T read data: 0.474843 2021-03-09 17:43:36.676: INFO @log_profile : T hooks: 2.546399 2021-03-09 17:43:36.676: INFO @main_loop : Epoch 55 done 2021-03-09 17:43:36.676: INFO @main_loop : Training epoch 56 2021-03-09 17:43:54.705: INFO @log_variables: train loss nanmean: 1.662536 2021-03-09 17:43:54.705: INFO @log_variables: train age_loss mean: 12.562325 2021-03-09 17:43:54.705: INFO @log_variables: train gender_loss mean: 0.432745 2021-03-09 17:43:54.705: INFO @log_variables: train age_mae mean: 11.864592 2021-03-09 17:43:54.705: INFO @log_variables: train gender_accuracy mean: 0.799841 2021-03-09 17:43:54.705: INFO @log_variables: train gender_confidence/loss nanmean: 0.076704 2021-03-09 17:43:54.705: INFO @log_variables: train gender_confidence/accuracy mean: 0.715639 2021-03-09 17:43:54.705: INFO @log_variables: train age_confidence/loss mean: 0.050399 2021-03-09 17:43:54.705: INFO @log_variables: train age_confidence/accuracy mean: 0.726056 2021-03-09 17:43:54.706: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:43:54.707: INFO @metrics_hook: train age_mae: 11.865 +-0.182 (13824) 2021-03-09 17:43:54.709: INFO @metrics_hook: train gender_accuracy: 0.800 +-0.007 (13824) 2021-03-09 17:43:56.708: INFO @decay_lr : LR updated to `0.00022657584` 2021-03-09 17:43:56.710: INFO @log_profile : T train: 17.158469 2021-03-09 17:43:56.710: INFO @log_profile : T read data: 0.311610 2021-03-09 17:43:56.710: INFO @log_profile : T hooks: 2.513938 2021-03-09 17:43:56.710: INFO @main_loop : Epoch 56 done 2021-03-09 17:43:56.710: INFO @main_loop : Training epoch 57 2021-03-09 17:44:14.745: INFO @log_variables: train loss nanmean: 1.633128 2021-03-09 17:44:14.746: INFO @log_variables: train age_loss mean: 12.278894 2021-03-09 17:44:14.746: INFO @log_variables: train gender_loss mean: 0.429976 2021-03-09 17:44:14.746: INFO @log_variables: train age_mae mean: 11.589242 2021-03-09 17:44:14.746: INFO @log_variables: train gender_accuracy mean: 0.798828 2021-03-09 17:44:14.746: INFO @log_variables: train gender_confidence/loss nanmean: 0.075384 2021-03-09 17:44:14.746: INFO @log_variables: train gender_confidence/accuracy mean: 0.721788 2021-03-09 17:44:14.746: INFO @log_variables: train age_confidence/loss mean: 0.050594 2021-03-09 17:44:14.746: INFO @log_variables: train age_confidence/accuracy mean: 0.722656 2021-03-09 17:44:14.746: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:44:14.747: INFO @metrics_hook: train age_mae: 11.589 +-0.177 (13824) 2021-03-09 17:44:14.748: INFO @metrics_hook: train gender_accuracy: 0.799 +-0.007 (13824) 2021-03-09 17:44:16.752: INFO @decay_lr : LR updated to `0.00022544296` 2021-03-09 17:44:16.753: INFO @log_profile : T train: 17.180666 2021-03-09 17:44:16.753: INFO @log_profile : T read data: 0.312452 2021-03-09 17:44:16.754: INFO @log_profile : T hooks: 2.499843 2021-03-09 17:44:16.754: INFO @main_loop : Epoch 57 done 2021-03-09 17:44:16.754: INFO @main_loop : Training epoch 58 2021-03-09 17:44:35.380: INFO @log_variables: train loss nanmean: 1.644123 2021-03-09 17:44:35.381: INFO @log_variables: train age_loss mean: 12.298335 2021-03-09 17:44:35.381: INFO @log_variables: train gender_loss mean: 0.439325 2021-03-09 17:44:35.381: INFO @log_variables: train age_mae mean: 11.609576 2021-03-09 17:44:35.381: INFO @log_variables: train gender_accuracy mean: 0.793186 2021-03-09 17:44:35.381: INFO @log_variables: train gender_confidence/loss nanmean: 0.075970 2021-03-09 17:44:35.381: INFO @log_variables: train gender_confidence/accuracy mean: 0.716580 2021-03-09 17:44:35.381: INFO @log_variables: train age_confidence/loss mean: 0.050736 2021-03-09 17:44:35.381: INFO @log_variables: train age_confidence/accuracy mean: 0.718388 2021-03-09 17:44:35.381: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:44:35.383: INFO @metrics_hook: train age_mae: 11.610 +-0.176 (13824) 2021-03-09 17:44:35.385: INFO @metrics_hook: train gender_accuracy: 0.793 +-0.007 (13824) 2021-03-09 17:44:37.477: INFO @decay_lr : LR updated to `0.00022431574` 2021-03-09 17:44:37.479: INFO @log_profile : T train: 17.643727 2021-03-09 17:44:37.479: INFO @log_profile : T read data: 0.422866 2021-03-09 17:44:37.479: INFO @log_profile : T hooks: 2.609664 2021-03-09 17:44:37.479: INFO @main_loop : Epoch 58 done 2021-03-09 17:44:37.479: INFO @main_loop : Training epoch 59 2021-03-09 17:44:55.592: INFO @log_variables: train loss nanmean: 1.641623 2021-03-09 17:44:55.592: INFO @log_variables: train age_loss mean: 12.435555 2021-03-09 17:44:55.592: INFO @log_variables: train gender_loss mean: 0.424537 2021-03-09 17:44:55.592: INFO @log_variables: train age_mae mean: 11.744311 2021-03-09 17:44:55.593: INFO @log_variables: train gender_accuracy mean: 0.800492 2021-03-09 17:44:55.593: INFO @log_variables: train gender_confidence/loss nanmean: 0.075209 2021-03-09 17:44:55.593: INFO @log_variables: train gender_confidence/accuracy mean: 0.724537 2021-03-09 17:44:55.593: INFO @log_variables: train age_confidence/loss mean: 0.049967 2021-03-09 17:44:55.593: INFO @log_variables: train age_confidence/accuracy mean: 0.724537 2021-03-09 17:44:55.593: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:44:55.595: INFO @metrics_hook: train age_mae: 11.744 +-0.178 (13824) 2021-03-09 17:44:55.597: INFO @metrics_hook: train gender_accuracy: 0.800 +-0.007 (13824) 2021-03-09 17:44:58.073: INFO @decay_lr : LR updated to `0.00022319416` 2021-03-09 17:44:58.075: INFO @log_profile : T train: 17.217363 2021-03-09 17:44:58.075: INFO @log_profile : T read data: 0.314851 2021-03-09 17:44:58.075: INFO @log_profile : T hooks: 3.012883 2021-03-09 17:44:58.075: INFO @main_loop : Epoch 59 done 2021-03-09 17:44:58.075: INFO @main_loop : Training epoch 60 2021-03-09 17:45:16.586: INFO @log_variables: train loss nanmean: 1.630904 2021-03-09 17:45:16.586: INFO @log_variables: train age_loss mean: 12.421403 2021-03-09 17:45:16.586: INFO @log_variables: train gender_loss mean: 0.413738 2021-03-09 17:45:16.586: INFO @log_variables: train age_mae mean: 11.728674 2021-03-09 17:45:16.586: INFO @log_variables: train gender_accuracy mean: 0.812500 2021-03-09 17:45:16.586: INFO @log_variables: train gender_confidence/loss nanmean: 0.075367 2021-03-09 17:45:16.586: INFO @log_variables: train gender_confidence/accuracy mean: 0.725694 2021-03-09 17:45:16.586: INFO @log_variables: train age_confidence/loss mean: 0.050193 2021-03-09 17:45:16.586: INFO @log_variables: train age_confidence/accuracy mean: 0.723597 2021-03-09 17:45:16.587: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:45:16.588: INFO @metrics_hook: train age_mae: 11.729 +-0.178 (13824) 2021-03-09 17:45:16.591: INFO @metrics_hook: train gender_accuracy: 0.812 +-0.007 (13824) 2021-03-09 17:45:18.782: INFO @decay_lr : LR updated to `0.00022207819` 2021-03-09 17:45:18.783: INFO @log_profile : T train: 17.635209 2021-03-09 17:45:18.784: INFO @log_profile : T read data: 0.348416 2021-03-09 17:45:18.784: INFO @log_profile : T hooks: 2.674166 2021-03-09 17:45:18.784: INFO @main_loop : Epoch 60 done 2021-03-09 17:45:18.784: INFO @main_loop : Training epoch 61 2021-03-09 17:45:37.487: INFO @log_variables: train loss nanmean: 1.623454 2021-03-09 17:45:37.489: INFO @log_variables: train age_loss mean: 12.297738 2021-03-09 17:45:37.490: INFO @log_variables: train gender_loss mean: 0.417096 2021-03-09 17:45:37.491: INFO @log_variables: train age_mae mean: 11.610137 2021-03-09 17:45:37.491: INFO @log_variables: train gender_accuracy mean: 0.807292 2021-03-09 17:45:37.491: INFO @log_variables: train gender_confidence/loss nanmean: 0.075403 2021-03-09 17:45:37.491: INFO @log_variables: train gender_confidence/accuracy mean: 0.724175 2021-03-09 17:45:37.491: INFO @log_variables: train age_confidence/loss mean: 0.050896 2021-03-09 17:45:37.491: INFO @log_variables: train age_confidence/accuracy mean: 0.721137 2021-03-09 17:45:37.491: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:45:37.493: INFO @metrics_hook: train age_mae: 11.610 +-0.176 (13824) 2021-03-09 17:45:37.495: INFO @metrics_hook: train gender_accuracy: 0.807 +-0.007 (13824) 2021-03-09 17:45:39.853: INFO @decay_lr : LR updated to `0.0002209678` 2021-03-09 17:45:39.854: INFO @log_profile : T train: 17.656856 2021-03-09 17:45:39.854: INFO @log_profile : T read data: 0.516717 2021-03-09 17:45:39.854: INFO @log_profile : T hooks: 2.844003 2021-03-09 17:45:39.854: INFO @main_loop : Epoch 61 done 2021-03-09 17:45:39.855: INFO @main_loop : Training epoch 62 2021-03-09 17:45:59.643: INFO @log_variables: train loss nanmean: 1.634019 2021-03-09 17:45:59.644: INFO @log_variables: train age_loss mean: 12.387885 2021-03-09 17:45:59.644: INFO @log_variables: train gender_loss mean: 0.420824 2021-03-09 17:45:59.644: INFO @log_variables: train age_mae mean: 11.698217 2021-03-09 17:45:59.644: INFO @log_variables: train gender_accuracy mean: 0.805049 2021-03-09 17:45:59.644: INFO @log_variables: train gender_confidence/loss nanmean: 0.075281 2021-03-09 17:45:59.644: INFO @log_variables: train gender_confidence/accuracy mean: 0.723886 2021-03-09 17:45:59.644: INFO @log_variables: train age_confidence/loss mean: 0.049999 2021-03-09 17:45:59.644: INFO @log_variables: train age_confidence/accuracy mean: 0.724465 2021-03-09 17:45:59.644: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:45:59.646: INFO @metrics_hook: train age_mae: 11.698 +-0.176 (13824) 2021-03-09 17:45:59.648: INFO @metrics_hook: train gender_accuracy: 0.805 +-0.007 (13824) 2021-03-09 17:46:02.434: INFO @decay_lr : LR updated to `0.00021986297` 2021-03-09 17:46:02.436: INFO @log_profile : T train: 18.823497 2021-03-09 17:46:02.436: INFO @log_profile : T read data: 0.434870 2021-03-09 17:46:02.436: INFO @log_profile : T hooks: 3.269888 2021-03-09 17:46:02.437: INFO @main_loop : Epoch 62 done 2021-03-09 17:46:02.437: INFO @main_loop : Training epoch 63 2021-03-09 17:46:22.662: INFO @log_variables: train loss nanmean: 1.636096 2021-03-09 17:46:22.662: INFO @log_variables: train age_loss mean: 12.349730 2021-03-09 17:46:22.663: INFO @log_variables: train gender_loss mean: 0.427357 2021-03-09 17:46:22.663: INFO @log_variables: train age_mae mean: 11.663726 2021-03-09 17:46:22.663: INFO @log_variables: train gender_accuracy mean: 0.799913 2021-03-09 17:46:22.663: INFO @log_variables: train gender_confidence/loss nanmean: 0.074971 2021-03-09 17:46:22.663: INFO @log_variables: train gender_confidence/accuracy mean: 0.716291 2021-03-09 17:46:22.663: INFO @log_variables: train age_confidence/loss mean: 0.049916 2021-03-09 17:46:22.663: INFO @log_variables: train age_confidence/accuracy mean: 0.723597 2021-03-09 17:46:22.663: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:46:22.665: INFO @metrics_hook: train age_mae: 11.664 +-0.178 (13824) 2021-03-09 17:46:22.667: INFO @metrics_hook: train gender_accuracy: 0.800 +-0.007 (13824) 2021-03-09 17:46:25.080: INFO @decay_lr : LR updated to `0.00021876366` 2021-03-09 17:46:25.081: INFO @log_profile : T train: 19.223961 2021-03-09 17:46:25.081: INFO @log_profile : T read data: 0.473926 2021-03-09 17:46:25.081: INFO @log_profile : T hooks: 2.895704 2021-03-09 17:46:25.082: INFO @main_loop : Epoch 63 done 2021-03-09 17:46:25.082: INFO @main_loop : Training epoch 64 2021-03-09 17:46:44.526: INFO @log_variables: train loss nanmean: 1.608286 2021-03-09 17:46:44.526: INFO @log_variables: train age_loss mean: 12.164895 2021-03-09 17:46:44.526: INFO @log_variables: train gender_loss mean: 0.414746 2021-03-09 17:46:44.526: INFO @log_variables: train age_mae mean: 11.476287 2021-03-09 17:46:44.526: INFO @log_variables: train gender_accuracy mean: 0.807798 2021-03-09 17:46:44.526: INFO @log_variables: train gender_confidence/loss nanmean: 0.074644 2021-03-09 17:46:44.526: INFO @log_variables: train gender_confidence/accuracy mean: 0.727575 2021-03-09 17:46:44.526: INFO @log_variables: train age_confidence/loss mean: 0.050701 2021-03-09 17:46:44.526: INFO @log_variables: train age_confidence/accuracy mean: 0.720631 2021-03-09 17:46:44.526: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:46:44.528: INFO @metrics_hook: train age_mae: 11.476 +-0.176 (13824) 2021-03-09 17:46:44.530: INFO @metrics_hook: train gender_accuracy: 0.808 +-0.007 (13824) 2021-03-09 17:46:46.834: INFO @decay_lr : LR updated to `0.00021766983` 2021-03-09 17:46:46.836: INFO @log_profile : T train: 18.434259 2021-03-09 17:46:46.836: INFO @log_profile : T read data: 0.479006 2021-03-09 17:46:46.836: INFO @log_profile : T hooks: 2.787445 2021-03-09 17:46:46.836: INFO @main_loop : Epoch 64 done 2021-03-09 17:46:46.836: INFO @main_loop : Training epoch 65 2021-03-09 17:47:06.123: INFO @log_variables: train loss nanmean: 1.601401 2021-03-09 17:47:06.124: INFO @log_variables: train age_loss mean: 12.099946 2021-03-09 17:47:06.124: INFO @log_variables: train gender_loss mean: 0.412814 2021-03-09 17:47:06.124: INFO @log_variables: train age_mae mean: 11.413219 2021-03-09 17:47:06.124: INFO @log_variables: train gender_accuracy mean: 0.808883 2021-03-09 17:47:06.124: INFO @log_variables: train gender_confidence/loss nanmean: 0.074900 2021-03-09 17:47:06.124: INFO @log_variables: train gender_confidence/accuracy mean: 0.726780 2021-03-09 17:47:06.124: INFO @log_variables: train age_confidence/loss mean: 0.051220 2021-03-09 17:47:06.124: INFO @log_variables: train age_confidence/accuracy mean: 0.716652 2021-03-09 17:47:06.124: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:47:06.126: INFO @metrics_hook: train age_mae: 11.413 +-0.176 (13824) 2021-03-09 17:47:06.129: INFO @metrics_hook: train gender_accuracy: 0.809 +-0.007 (13824) 2021-03-09 17:47:08.591: INFO @decay_lr : LR updated to `0.00021658148` 2021-03-09 17:47:08.593: INFO @log_profile : T train: 18.386262 2021-03-09 17:47:08.593: INFO @log_profile : T read data: 0.362433 2021-03-09 17:47:08.593: INFO @log_profile : T hooks: 2.954249 2021-03-09 17:47:08.593: INFO @main_loop : Epoch 65 done 2021-03-09 17:47:08.593: INFO @main_loop : Training epoch 66 2021-03-09 17:47:30.300: INFO @log_variables: train loss nanmean: 1.594883 2021-03-09 17:47:30.303: INFO @log_variables: train age_loss mean: 12.045898 2021-03-09 17:47:30.305: INFO @log_variables: train gender_loss mean: 0.411142 2021-03-09 17:47:30.309: INFO @log_variables: train age_mae mean: 11.361421 2021-03-09 17:47:30.311: INFO @log_variables: train gender_accuracy mean: 0.810475 2021-03-09 17:47:30.313: INFO @log_variables: train gender_confidence/loss nanmean: 0.074818 2021-03-09 17:47:30.316: INFO @log_variables: train gender_confidence/accuracy mean: 0.725188 2021-03-09 17:47:30.317: INFO @log_variables: train age_confidence/loss mean: 0.051219 2021-03-09 17:47:30.317: INFO @log_variables: train age_confidence/accuracy mean: 0.717665 2021-03-09 17:47:30.317: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:47:30.324: INFO @metrics_hook: train age_mae: 11.361 +-0.175 (13824) 2021-03-09 17:47:30.330: INFO @metrics_hook: train gender_accuracy: 0.810 +-0.007 (13824) 2021-03-09 17:47:33.183: INFO @decay_lr : LR updated to `0.00021549857` 2021-03-09 17:47:33.185: INFO @log_profile : T train: 20.621214 2021-03-09 17:47:33.185: INFO @log_profile : T read data: 0.528238 2021-03-09 17:47:33.185: INFO @log_profile : T hooks: 3.387834 2021-03-09 17:47:33.185: INFO @main_loop : Epoch 66 done 2021-03-09 17:47:33.185: INFO @main_loop : Training epoch 67 2021-03-09 17:47:55.034: INFO @log_variables: train loss nanmean: 1.594715 2021-03-09 17:47:55.034: INFO @log_variables: train age_loss mean: 12.014079 2021-03-09 17:47:55.034: INFO @log_variables: train gender_loss mean: 0.413559 2021-03-09 17:47:55.034: INFO @log_variables: train age_mae mean: 11.334493 2021-03-09 17:47:55.034: INFO @log_variables: train gender_accuracy mean: 0.810113 2021-03-09 17:47:55.034: INFO @log_variables: train gender_confidence/loss nanmean: 0.075338 2021-03-09 17:47:55.035: INFO @log_variables: train gender_confidence/accuracy mean: 0.727720 2021-03-09 17:47:55.035: INFO @log_variables: train age_confidence/loss mean: 0.051225 2021-03-09 17:47:55.035: INFO @log_variables: train age_confidence/accuracy mean: 0.712891 2021-03-09 17:47:55.035: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:47:55.036: INFO @metrics_hook: train age_mae: 11.334 +-0.176 (13824) 2021-03-09 17:47:55.037: INFO @metrics_hook: train gender_accuracy: 0.810 +-0.007 (13824) 2021-03-09 17:47:57.511: INFO @decay_lr : LR updated to `0.00021442107` 2021-03-09 17:47:57.512: INFO @log_profile : T train: 20.702412 2021-03-09 17:47:57.512: INFO @log_profile : T read data: 0.582330 2021-03-09 17:47:57.512: INFO @log_profile : T hooks: 2.983822 2021-03-09 17:47:57.512: INFO @main_loop : Epoch 67 done 2021-03-09 17:47:57.512: INFO @main_loop : Training epoch 68 2021-03-09 17:48:19.478: INFO @log_variables: train loss nanmean: 1.595414 2021-03-09 17:48:19.479: INFO @log_variables: train age_loss mean: 12.111860 2021-03-09 17:48:19.479: INFO @log_variables: train gender_loss mean: 0.404941 2021-03-09 17:48:19.479: INFO @log_variables: train age_mae mean: 11.424722 2021-03-09 17:48:19.480: INFO @log_variables: train gender_accuracy mean: 0.812486 2021-03-09 17:48:19.480: INFO @log_variables: train gender_confidence/loss nanmean: 0.074659 2021-03-09 17:48:19.480: INFO @log_variables: train gender_confidence/accuracy mean: 0.732764 2021-03-09 17:48:19.480: INFO @log_variables: train age_confidence/loss mean: 0.051549 2021-03-09 17:48:19.480: INFO @log_variables: train age_confidence/accuracy mean: 0.711278 2021-03-09 17:48:19.480: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:48:19.485: INFO @metrics_hook: train age_mae: 11.425 +-0.176 (13823) 2021-03-09 17:48:19.487: INFO @metrics_hook: train gender_accuracy: 0.812 +-0.007 (13823) 2021-03-09 17:48:22.948: INFO @decay_lr : LR updated to `0.00021334896` 2021-03-09 17:48:22.952: INFO @log_profile : T train: 20.703001 2021-03-09 17:48:22.952: INFO @log_profile : T read data: 0.694874 2021-03-09 17:48:22.952: INFO @log_profile : T hooks: 3.984426 2021-03-09 17:48:22.952: INFO @main_loop : Epoch 68 done 2021-03-09 17:48:22.952: INFO @main_loop : Training epoch 69 2021-03-09 17:48:45.398: INFO @log_variables: train loss nanmean: 1.585361 2021-03-09 17:48:45.404: INFO @log_variables: train age_loss mean: 12.005032 2021-03-09 17:48:45.405: INFO @log_variables: train gender_loss mean: 0.405072 2021-03-09 17:48:45.405: INFO @log_variables: train age_mae mean: 11.323646 2021-03-09 17:48:45.405: INFO @log_variables: train gender_accuracy mean: 0.812717 2021-03-09 17:48:45.405: INFO @log_variables: train gender_confidence/loss nanmean: 0.074784 2021-03-09 17:48:45.405: INFO @log_variables: train gender_confidence/accuracy mean: 0.723307 2021-03-09 17:48:45.405: INFO @log_variables: train age_confidence/loss mean: 0.050964 2021-03-09 17:48:45.405: INFO @log_variables: train age_confidence/accuracy mean: 0.719473 2021-03-09 17:48:45.405: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:48:45.412: INFO @metrics_hook: train age_mae: 11.324 +-0.174 (13824) 2021-03-09 17:48:45.422: INFO @metrics_hook: train gender_accuracy: 0.813 +-0.007 (13824) 2021-03-09 17:48:50.527: INFO @decay_lr : LR updated to `0.00021228222` 2021-03-09 17:48:50.528: INFO @log_profile : T train: 21.460424 2021-03-09 17:48:50.528: INFO @log_profile : T read data: 0.433429 2021-03-09 17:48:50.528: INFO @log_profile : T hooks: 5.623652 2021-03-09 17:48:50.528: INFO @main_loop : Epoch 69 done 2021-03-09 17:48:50.529: INFO @main_loop : Training epoch 70 2021-03-09 17:49:11.706: INFO @log_variables: train loss nanmean: 1.571297 2021-03-09 17:49:11.706: INFO @log_variables: train age_loss mean: 11.922924 2021-03-09 17:49:11.706: INFO @log_variables: train gender_loss mean: 0.398488 2021-03-09 17:49:11.707: INFO @log_variables: train age_mae mean: 11.244972 2021-03-09 17:49:11.707: INFO @log_variables: train gender_accuracy mean: 0.818866 2021-03-09 17:49:11.707: INFO @log_variables: train gender_confidence/loss nanmean: 0.074558 2021-03-09 17:49:11.707: INFO @log_variables: train gender_confidence/accuracy mean: 0.730324 2021-03-09 17:49:11.707: INFO @log_variables: train age_confidence/loss mean: 0.050574 2021-03-09 17:49:11.707: INFO @log_variables: train age_confidence/accuracy mean: 0.721499 2021-03-09 17:49:11.707: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:49:11.710: INFO @metrics_hook: train age_mae: 11.245 +-0.173 (13824) 2021-03-09 17:49:11.713: INFO @metrics_hook: train gender_accuracy: 0.819 +-0.007 (13824) 2021-03-09 17:49:14.592: INFO @decay_lr : LR updated to `0.0002112208` 2021-03-09 17:49:14.597: INFO @log_profile : T train: 20.149269 2021-03-09 17:49:14.598: INFO @log_profile : T read data: 0.479778 2021-03-09 17:49:14.600: INFO @log_profile : T hooks: 3.383001 2021-03-09 17:49:14.602: INFO @main_loop : Epoch 70 done 2021-03-09 17:49:14.603: INFO @main_loop : Training epoch 71 2021-03-09 17:49:35.148: INFO @log_variables: train loss nanmean: 1.577765 2021-03-09 17:49:35.148: INFO @log_variables: train age_loss mean: 11.959133 2021-03-09 17:49:35.148: INFO @log_variables: train gender_loss mean: 0.400485 2021-03-09 17:49:35.148: INFO @log_variables: train age_mae mean: 11.279277 2021-03-09 17:49:35.148: INFO @log_variables: train gender_accuracy mean: 0.817274 2021-03-09 17:49:35.148: INFO @log_variables: train gender_confidence/loss nanmean: 0.075325 2021-03-09 17:49:35.148: INFO @log_variables: train gender_confidence/accuracy mean: 0.728588 2021-03-09 17:49:35.148: INFO @log_variables: train age_confidence/loss mean: 0.051169 2021-03-09 17:49:35.149: INFO @log_variables: train age_confidence/accuracy mean: 0.715856 2021-03-09 17:49:35.149: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:49:35.150: INFO @metrics_hook: train age_mae: 11.279 +-0.175 (13824) 2021-03-09 17:49:35.151: INFO @metrics_hook: train gender_accuracy: 0.817 +-0.007 (13824) 2021-03-09 17:49:37.747: INFO @decay_lr : LR updated to `0.0002101647` 2021-03-09 17:49:37.748: INFO @log_profile : T train: 19.309290 2021-03-09 17:49:37.748: INFO @log_profile : T read data: 0.666488 2021-03-09 17:49:37.748: INFO @log_profile : T hooks: 3.105557 2021-03-09 17:49:37.748: INFO @main_loop : Epoch 71 done 2021-03-09 17:49:37.748: INFO @main_loop : Training epoch 72 2021-03-09 17:49:57.932: INFO @log_variables: train loss nanmean: 1.576788 2021-03-09 17:49:57.932: INFO @log_variables: train age_loss mean: 11.909514 2021-03-09 17:49:57.932: INFO @log_variables: train gender_loss mean: 0.404646 2021-03-09 17:49:57.932: INFO @log_variables: train age_mae mean: 11.234785 2021-03-09 17:49:57.932: INFO @log_variables: train gender_accuracy mean: 0.814959 2021-03-09 17:49:57.932: INFO @log_variables: train gender_confidence/loss nanmean: 0.074705 2021-03-09 17:49:57.932: INFO @log_variables: train gender_confidence/accuracy mean: 0.729022 2021-03-09 17:49:57.932: INFO @log_variables: train age_confidence/loss mean: 0.051539 2021-03-09 17:49:57.932: INFO @log_variables: train age_confidence/accuracy mean: 0.712312 2021-03-09 17:49:57.933: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:49:57.934: INFO @metrics_hook: train age_mae: 11.235 +-0.175 (13824) 2021-03-09 17:49:57.936: INFO @metrics_hook: train gender_accuracy: 0.815 +-0.007 (13824) 2021-03-09 17:50:00.479: INFO @decay_lr : LR updated to `0.00020911387` 2021-03-09 17:50:00.481: INFO @log_profile : T train: 19.209304 2021-03-09 17:50:00.481: INFO @log_profile : T read data: 0.434291 2021-03-09 17:50:00.481: INFO @log_profile : T hooks: 3.036080 2021-03-09 17:50:00.481: INFO @main_loop : Epoch 72 done 2021-03-09 17:50:00.481: INFO @main_loop : Training epoch 73 2021-03-09 17:50:19.162: INFO @log_variables: train loss nanmean: 1.571342 2021-03-09 17:50:19.162: INFO @log_variables: train age_loss mean: 11.927471 2021-03-09 17:50:19.162: INFO @log_variables: train gender_loss mean: 0.396760 2021-03-09 17:50:19.162: INFO @log_variables: train age_mae mean: 11.252156 2021-03-09 17:50:19.163: INFO @log_variables: train gender_accuracy mean: 0.819083 2021-03-09 17:50:19.163: INFO @log_variables: train gender_confidence/loss nanmean: 0.074645 2021-03-09 17:50:19.163: INFO @log_variables: train gender_confidence/accuracy mean: 0.732639 2021-03-09 17:50:19.163: INFO @log_variables: train age_confidence/loss mean: 0.051690 2021-03-09 17:50:19.163: INFO @log_variables: train age_confidence/accuracy mean: 0.708695 2021-03-09 17:50:19.163: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:50:19.165: INFO @metrics_hook: train age_mae: 11.252 +-0.175 (13824) 2021-03-09 17:50:19.168: INFO @metrics_hook: train gender_accuracy: 0.819 +-0.007 (13824) 2021-03-09 17:50:21.425: INFO @decay_lr : LR updated to `0.0002080683` 2021-03-09 17:50:21.426: INFO @log_profile : T train: 17.787014 2021-03-09 17:50:21.426: INFO @log_profile : T read data: 0.340436 2021-03-09 17:50:21.426: INFO @log_profile : T hooks: 2.764756 2021-03-09 17:50:21.426: INFO @main_loop : Epoch 73 done 2021-03-09 17:50:21.426: INFO @main_loop : Training epoch 74 2021-03-09 17:50:40.111: INFO @log_variables: train loss nanmean: 1.544751 2021-03-09 17:50:40.111: INFO @log_variables: train age_loss mean: 11.799475 2021-03-09 17:50:40.111: INFO @log_variables: train gender_loss mean: 0.381147 2021-03-09 17:50:40.112: INFO @log_variables: train age_mae mean: 11.128331 2021-03-09 17:50:40.112: INFO @log_variables: train gender_accuracy mean: 0.825882 2021-03-09 17:50:40.112: INFO @log_variables: train gender_confidence/loss nanmean: 0.074109 2021-03-09 17:50:40.112: INFO @log_variables: train gender_confidence/accuracy mean: 0.733290 2021-03-09 17:50:40.112: INFO @log_variables: train age_confidence/loss mean: 0.051466 2021-03-09 17:50:40.112: INFO @log_variables: train age_confidence/accuracy mean: 0.714482 2021-03-09 17:50:40.112: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:50:40.114: INFO @metrics_hook: train age_mae: 11.128 +-0.173 (13824) 2021-03-09 17:50:40.116: INFO @metrics_hook: train gender_accuracy: 0.826 +-0.006 (13824) 2021-03-09 17:50:42.334: INFO @decay_lr : LR updated to `0.00020702796` 2021-03-09 17:50:42.335: INFO @log_profile : T train: 17.682069 2021-03-09 17:50:42.335: INFO @log_profile : T read data: 0.458995 2021-03-09 17:50:42.336: INFO @log_profile : T hooks: 2.717120 2021-03-09 17:50:42.336: INFO @main_loop : Epoch 74 done 2021-03-09 17:50:42.336: INFO @main_loop : Training epoch 75 2021-03-09 17:51:00.925: INFO @log_variables: train loss nanmean: 1.567789 2021-03-09 17:51:00.926: INFO @log_variables: train age_loss mean: 11.932303 2021-03-09 17:51:00.926: INFO @log_variables: train gender_loss mean: 0.393349 2021-03-09 17:51:00.926: INFO @log_variables: train age_mae mean: 11.263007 2021-03-09 17:51:00.926: INFO @log_variables: train gender_accuracy mean: 0.822483 2021-03-09 17:51:00.926: INFO @log_variables: train gender_confidence/loss nanmean: 0.074721 2021-03-09 17:51:00.926: INFO @log_variables: train gender_confidence/accuracy mean: 0.736473 2021-03-09 17:51:00.926: INFO @log_variables: train age_confidence/loss mean: 0.050724 2021-03-09 17:51:00.926: INFO @log_variables: train age_confidence/accuracy mean: 0.719546 2021-03-09 17:51:00.926: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:51:00.928: INFO @metrics_hook: train age_mae: 11.263 +-0.173 (13824) 2021-03-09 17:51:00.930: INFO @metrics_hook: train gender_accuracy: 0.822 +-0.006 (13824) 2021-03-09 17:51:03.296: INFO @decay_lr : LR updated to `0.00020599282` 2021-03-09 17:51:03.297: INFO @log_profile : T train: 17.694251 2021-03-09 17:51:03.298: INFO @log_profile : T read data: 0.363539 2021-03-09 17:51:03.298: INFO @log_profile : T hooks: 2.851855 2021-03-09 17:51:03.298: INFO @main_loop : Epoch 75 done 2021-03-09 17:51:03.298: INFO @main_loop : Training epoch 76 2021-03-09 17:51:21.864: INFO @log_variables: train loss nanmean: 1.552490 2021-03-09 17:51:21.864: INFO @log_variables: train age_loss mean: 11.686079 2021-03-09 17:51:21.865: INFO @log_variables: train gender_loss mean: 0.399608 2021-03-09 17:51:21.865: INFO @log_variables: train age_mae mean: 11.019102 2021-03-09 17:51:21.865: INFO @log_variables: train gender_accuracy mean: 0.818359 2021-03-09 17:51:21.865: INFO @log_variables: train gender_confidence/loss nanmean: 0.074965 2021-03-09 17:51:21.865: INFO @log_variables: train gender_confidence/accuracy mean: 0.734881 2021-03-09 17:51:21.865: INFO @log_variables: train age_confidence/loss mean: 0.051875 2021-03-09 17:51:21.865: INFO @log_variables: train age_confidence/accuracy mean: 0.708189 2021-03-09 17:51:21.866: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:51:21.868: INFO @metrics_hook: train age_mae: 11.019 +-0.172 (13824) 2021-03-09 17:51:21.871: INFO @metrics_hook: train gender_accuracy: 0.818 +-0.007 (13824) 2021-03-09 17:51:24.007: INFO @decay_lr : LR updated to `0.00020496285` 2021-03-09 17:51:24.008: INFO @log_profile : T train: 17.684020 2021-03-09 17:51:24.008: INFO @log_profile : T read data: 0.318135 2021-03-09 17:51:24.009: INFO @log_profile : T hooks: 2.655106 2021-03-09 17:51:24.009: INFO @main_loop : Epoch 76 done 2021-03-09 17:51:24.009: INFO @main_loop : Training epoch 77 2021-03-09 17:51:42.409: INFO @log_variables: train loss nanmean: 1.532288 2021-03-09 17:51:42.409: INFO @log_variables: train age_loss mean: 11.621564 2021-03-09 17:51:42.409: INFO @log_variables: train gender_loss mean: 0.383824 2021-03-09 17:51:42.410: INFO @log_variables: train age_mae mean: 10.956035 2021-03-09 17:51:42.410: INFO @log_variables: train gender_accuracy mean: 0.827763 2021-03-09 17:51:42.410: INFO @log_variables: train gender_confidence/loss nanmean: 0.075185 2021-03-09 17:51:42.410: INFO @log_variables: train gender_confidence/accuracy mean: 0.740162 2021-03-09 17:51:42.410: INFO @log_variables: train age_confidence/loss mean: 0.051666 2021-03-09 17:51:42.410: INFO @log_variables: train age_confidence/accuracy mean: 0.711082 2021-03-09 17:51:42.410: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:51:42.412: INFO @metrics_hook: train age_mae: 10.956 +-0.171 (13824) 2021-03-09 17:51:42.415: INFO @metrics_hook: train gender_accuracy: 0.828 +-0.006 (13824) 2021-03-09 17:51:45.078: INFO @decay_lr : LR updated to `0.00020393803` 2021-03-09 17:51:45.080: INFO @log_profile : T train: 17.427273 2021-03-09 17:51:45.080: INFO @log_profile : T read data: 0.438410 2021-03-09 17:51:45.080: INFO @log_profile : T hooks: 3.154935 2021-03-09 17:51:45.080: INFO @main_loop : Epoch 77 done 2021-03-09 17:51:45.080: INFO @main_loop : Training epoch 78 2021-03-09 17:52:03.722: INFO @log_variables: train loss nanmean: 1.537146 2021-03-09 17:52:03.722: INFO @log_variables: train age_loss mean: 11.679502 2021-03-09 17:52:03.722: INFO @log_variables: train gender_loss mean: 0.384510 2021-03-09 17:52:03.722: INFO @log_variables: train age_mae mean: 11.013080 2021-03-09 17:52:03.722: INFO @log_variables: train gender_accuracy mean: 0.822266 2021-03-09 17:52:03.722: INFO @log_variables: train gender_confidence/loss nanmean: 0.073696 2021-03-09 17:52:03.722: INFO @log_variables: train gender_confidence/accuracy mean: 0.736907 2021-03-09 17:52:03.723: INFO @log_variables: train age_confidence/loss mean: 0.052123 2021-03-09 17:52:03.723: INFO @log_variables: train age_confidence/accuracy mean: 0.706742 2021-03-09 17:52:03.723: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:52:03.724: INFO @metrics_hook: train age_mae: 11.013 +-0.174 (13824) 2021-03-09 17:52:03.726: INFO @metrics_hook: train gender_accuracy: 0.822 +-0.007 (13824) 2021-03-09 17:52:06.422: INFO @decay_lr : LR updated to `0.00020291834` 2021-03-09 17:52:06.424: INFO @log_profile : T train: 17.759178 2021-03-09 17:52:06.424: INFO @log_profile : T read data: 0.354562 2021-03-09 17:52:06.424: INFO @log_profile : T hooks: 3.177545 2021-03-09 17:52:06.424: INFO @main_loop : Epoch 78 done 2021-03-09 17:52:06.424: INFO @main_loop : Training epoch 79 2021-03-09 17:52:25.101: INFO @log_variables: train loss nanmean: 1.522442 2021-03-09 17:52:25.101: INFO @log_variables: train age_loss mean: 11.507222 2021-03-09 17:52:25.101: INFO @log_variables: train gender_loss mean: 0.384336 2021-03-09 17:52:25.101: INFO @log_variables: train age_mae mean: 10.845956 2021-03-09 17:52:25.101: INFO @log_variables: train gender_accuracy mean: 0.825738 2021-03-09 17:52:25.102: INFO @log_variables: train gender_confidence/loss nanmean: 0.074352 2021-03-09 17:52:25.102: INFO @log_variables: train gender_confidence/accuracy mean: 0.737413 2021-03-09 17:52:25.102: INFO @log_variables: train age_confidence/loss mean: 0.052583 2021-03-09 17:52:25.102: INFO @log_variables: train age_confidence/accuracy mean: 0.704065 2021-03-09 17:52:25.102: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:52:25.103: INFO @metrics_hook: train age_mae: 10.846 +-0.170 (13824) 2021-03-09 17:52:25.104: INFO @metrics_hook: train gender_accuracy: 0.826 +-0.006 (13824) 2021-03-09 17:52:27.882: INFO @decay_lr : LR updated to `0.00020190375` 2021-03-09 17:52:27.883: INFO @log_profile : T train: 17.766585 2021-03-09 17:52:27.883: INFO @log_profile : T read data: 0.378286 2021-03-09 17:52:27.883: INFO @log_profile : T hooks: 3.261666 2021-03-09 17:52:27.884: INFO @main_loop : Epoch 79 done 2021-03-09 17:52:27.884: INFO @main_loop : Training epoch 80 2021-03-09 17:52:47.537: INFO @log_variables: train loss nanmean: 1.536623 2021-03-09 17:52:47.537: INFO @log_variables: train age_loss mean: 11.641109 2021-03-09 17:52:47.537: INFO @log_variables: train gender_loss mean: 0.388350 2021-03-09 17:52:47.538: INFO @log_variables: train age_mae mean: 10.978460 2021-03-09 17:52:47.538: INFO @log_variables: train gender_accuracy mean: 0.822483 2021-03-09 17:52:47.538: INFO @log_variables: train gender_confidence/loss nanmean: 0.073803 2021-03-09 17:52:47.538: INFO @log_variables: train gender_confidence/accuracy mean: 0.736473 2021-03-09 17:52:47.538: INFO @log_variables: train age_confidence/loss mean: 0.051492 2021-03-09 17:52:47.538: INFO @log_variables: train age_confidence/accuracy mean: 0.711589 2021-03-09 17:52:47.538: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:52:47.540: INFO @metrics_hook: train age_mae: 10.978 +-0.172 (13824) 2021-03-09 17:52:47.542: INFO @metrics_hook: train gender_accuracy: 0.822 +-0.006 (13824) 2021-03-09 17:52:50.011: INFO @decay_lr : LR updated to `0.00020089422` 2021-03-09 17:52:50.012: INFO @log_profile : T train: 18.564621 2021-03-09 17:52:50.012: INFO @log_profile : T read data: 0.547148 2021-03-09 17:52:50.012: INFO @log_profile : T hooks: 2.963101 2021-03-09 17:52:50.013: INFO @main_loop : Epoch 80 done 2021-03-09 17:52:50.013: INFO @main_loop : Training epoch 81 2021-03-09 17:53:09.089: INFO @log_variables: train loss nanmean: 1.530784 2021-03-09 17:53:09.089: INFO @log_variables: train age_loss mean: 11.671367 2021-03-09 17:53:09.090: INFO @log_variables: train gender_loss mean: 0.378095 2021-03-09 17:53:09.090: INFO @log_variables: train age_mae mean: 11.007807 2021-03-09 17:53:09.090: INFO @log_variables: train gender_accuracy mean: 0.829716 2021-03-09 17:53:09.090: INFO @log_variables: train gender_confidence/loss nanmean: 0.073990 2021-03-09 17:53:09.090: INFO @log_variables: train gender_confidence/accuracy mean: 0.741970 2021-03-09 17:53:09.090: INFO @log_variables: train age_confidence/loss mean: 0.052039 2021-03-09 17:53:09.090: INFO @log_variables: train age_confidence/accuracy mean: 0.708116 2021-03-09 17:53:09.090: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:53:09.092: INFO @metrics_hook: train age_mae: 11.008 +-0.172 (13824) 2021-03-09 17:53:09.094: INFO @metrics_hook: train gender_accuracy: 0.830 +-0.006 (13824) 2021-03-09 17:53:11.219: INFO @decay_lr : LR updated to `0.00019988975` 2021-03-09 17:53:11.220: INFO @log_profile : T train: 18.206808 2021-03-09 17:53:11.221: INFO @log_profile : T read data: 0.325731 2021-03-09 17:53:11.221: INFO @log_profile : T hooks: 2.624071 2021-03-09 17:53:11.221: INFO @main_loop : Epoch 81 done 2021-03-09 17:53:11.221: INFO @main_loop : Training epoch 82 2021-03-09 17:53:30.008: INFO @log_variables: train loss nanmean: 1.541333 2021-03-09 17:53:30.008: INFO @log_variables: train age_loss mean: 11.717815 2021-03-09 17:53:30.008: INFO @log_variables: train gender_loss mean: 0.385866 2021-03-09 17:53:30.008: INFO @log_variables: train age_mae mean: 11.057226 2021-03-09 17:53:30.008: INFO @log_variables: train gender_accuracy mean: 0.821542 2021-03-09 17:53:30.008: INFO @log_variables: train gender_confidence/loss nanmean: 0.074115 2021-03-09 17:53:30.008: INFO @log_variables: train gender_confidence/accuracy mean: 0.734664 2021-03-09 17:53:30.008: INFO @log_variables: train age_confidence/loss mean: 0.051175 2021-03-09 17:53:30.009: INFO @log_variables: train age_confidence/accuracy mean: 0.717593 2021-03-09 17:53:30.009: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:53:30.011: INFO @metrics_hook: train age_mae: 11.057 +-0.173 (13824) 2021-03-09 17:53:30.013: INFO @metrics_hook: train gender_accuracy: 0.822 +-0.007 (13824) 2021-03-09 17:53:32.104: INFO @decay_lr : LR updated to `0.0001988903` 2021-03-09 17:53:32.107: INFO @log_profile : T train: 17.925530 2021-03-09 17:53:32.107: INFO @log_profile : T read data: 0.321078 2021-03-09 17:53:32.107: INFO @log_profile : T hooks: 2.589376 2021-03-09 17:53:32.107: INFO @main_loop : Epoch 82 done 2021-03-09 17:53:32.107: INFO @main_loop : Training epoch 83 2021-03-09 17:53:50.811: INFO @log_variables: train loss nanmean: 1.523886 2021-03-09 17:53:50.811: INFO @log_variables: train age_loss mean: 11.523632 2021-03-09 17:53:50.811: INFO @log_variables: train gender_loss mean: 0.384974 2021-03-09 17:53:50.811: INFO @log_variables: train age_mae mean: 10.863984 2021-03-09 17:53:50.811: INFO @log_variables: train gender_accuracy mean: 0.825593 2021-03-09 17:53:50.812: INFO @log_variables: train gender_confidence/loss nanmean: 0.074101 2021-03-09 17:53:50.812: INFO @log_variables: train gender_confidence/accuracy mean: 0.740307 2021-03-09 17:53:50.812: INFO @log_variables: train age_confidence/loss mean: 0.052206 2021-03-09 17:53:50.812: INFO @log_variables: train age_confidence/accuracy mean: 0.711082 2021-03-09 17:53:50.812: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:53:50.814: INFO @metrics_hook: train age_mae: 10.864 +-0.171 (13824) 2021-03-09 17:53:50.817: INFO @metrics_hook: train gender_accuracy: 0.826 +-0.006 (13824) 2021-03-09 17:53:52.930: INFO @decay_lr : LR updated to `0.00019789585` 2021-03-09 17:53:52.931: INFO @log_profile : T train: 17.782483 2021-03-09 17:53:52.931: INFO @log_profile : T read data: 0.321245 2021-03-09 17:53:52.931: INFO @log_profile : T hooks: 2.670410 2021-03-09 17:53:52.931: INFO @main_loop : Epoch 83 done 2021-03-09 17:53:52.931: INFO @main_loop : Training epoch 84 2021-03-09 17:54:12.051: INFO @log_variables: train loss nanmean: 1.514919 2021-03-09 17:54:12.052: INFO @log_variables: train age_loss mean: 11.468559 2021-03-09 17:54:12.052: INFO @log_variables: train gender_loss mean: 0.381627 2021-03-09 17:54:12.052: INFO @log_variables: train age_mae mean: 10.811857 2021-03-09 17:54:12.052: INFO @log_variables: train gender_accuracy mean: 0.823929 2021-03-09 17:54:12.052: INFO @log_variables: train gender_confidence/loss nanmean: 0.073446 2021-03-09 17:54:12.052: INFO @log_variables: train gender_confidence/accuracy mean: 0.741030 2021-03-09 17:54:12.052: INFO @log_variables: train age_confidence/loss mean: 0.051943 2021-03-09 17:54:12.052: INFO @log_variables: train age_confidence/accuracy mean: 0.706814 2021-03-09 17:54:12.052: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:54:12.053: INFO @metrics_hook: train age_mae: 10.812 +-0.168 (13824) 2021-03-09 17:54:12.054: INFO @metrics_hook: train gender_accuracy: 0.824 +-0.006 (13824) 2021-03-09 17:54:14.108: INFO @decay_lr : LR updated to `0.00019690637` 2021-03-09 17:54:14.109: INFO @log_profile : T train: 18.152629 2021-03-09 17:54:14.109: INFO @log_profile : T read data: 0.442438 2021-03-09 17:54:14.110: INFO @log_profile : T hooks: 2.534183 2021-03-09 17:54:14.110: INFO @main_loop : Epoch 84 done 2021-03-09 17:54:14.110: INFO @main_loop : Training epoch 85 2021-03-09 17:54:33.129: INFO @log_variables: train loss nanmean: 1.508187 2021-03-09 17:54:33.129: INFO @log_variables: train age_loss mean: 11.471313 2021-03-09 17:54:33.129: INFO @log_variables: train gender_loss mean: 0.372924 2021-03-09 17:54:33.129: INFO @log_variables: train age_mae mean: 10.816265 2021-03-09 17:54:33.129: INFO @log_variables: train gender_accuracy mean: 0.832610 2021-03-09 17:54:33.129: INFO @log_variables: train gender_confidence/loss nanmean: 0.073759 2021-03-09 17:54:33.129: INFO @log_variables: train gender_confidence/accuracy mean: 0.738209 2021-03-09 17:54:33.129: INFO @log_variables: train age_confidence/loss mean: 0.052560 2021-03-09 17:54:33.129: INFO @log_variables: train age_confidence/accuracy mean: 0.706308 2021-03-09 17:54:33.130: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:54:33.131: INFO @metrics_hook: train age_mae: 10.816 +-0.170 (13824) 2021-03-09 17:54:33.133: INFO @metrics_hook: train gender_accuracy: 0.833 +-0.006 (13824) 2021-03-09 17:54:35.482: INFO @decay_lr : LR updated to `0.00019592184` 2021-03-09 17:54:35.484: INFO @log_profile : T train: 18.069249 2021-03-09 17:54:35.484: INFO @log_profile : T read data: 0.333691 2021-03-09 17:54:35.484: INFO @log_profile : T hooks: 2.918561 2021-03-09 17:54:35.484: INFO @main_loop : Epoch 85 done 2021-03-09 17:54:35.484: INFO @main_loop : Training epoch 86 2021-03-09 17:54:55.167: INFO @log_variables: train loss nanmean: 1.505752 2021-03-09 17:54:55.169: INFO @log_variables: train age_loss mean: 11.425363 2021-03-09 17:54:55.169: INFO @log_variables: train gender_loss mean: 0.375898 2021-03-09 17:54:55.169: INFO @log_variables: train age_mae mean: 10.772017 2021-03-09 17:54:55.169: INFO @log_variables: train gender_accuracy mean: 0.829138 2021-03-09 17:54:55.169: INFO @log_variables: train gender_confidence/loss nanmean: 0.073037 2021-03-09 17:54:55.169: INFO @log_variables: train gender_confidence/accuracy mean: 0.746528 2021-03-09 17:54:55.170: INFO @log_variables: train age_confidence/loss mean: 0.052321 2021-03-09 17:54:55.170: INFO @log_variables: train age_confidence/accuracy mean: 0.709563 2021-03-09 17:54:55.170: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:54:55.172: INFO @metrics_hook: train age_mae: 10.772 +-0.170 (13824) 2021-03-09 17:54:55.174: INFO @metrics_hook: train gender_accuracy: 0.829 +-0.006 (13824) 2021-03-09 17:54:57.520: INFO @decay_lr : LR updated to `0.00019494223` 2021-03-09 17:54:57.522: INFO @log_profile : T train: 18.767769 2021-03-09 17:54:57.522: INFO @log_profile : T read data: 0.361452 2021-03-09 17:54:57.522: INFO @log_profile : T hooks: 2.852537 2021-03-09 17:54:57.522: INFO @main_loop : Epoch 86 done 2021-03-09 17:54:57.522: INFO @main_loop : Training epoch 87 2021-03-09 17:55:17.132: INFO @log_variables: train loss nanmean: 1.517240 2021-03-09 17:55:17.132: INFO @log_variables: train age_loss mean: 11.451662 2021-03-09 17:55:17.133: INFO @log_variables: train gender_loss mean: 0.384277 2021-03-09 17:55:17.133: INFO @log_variables: train age_mae mean: 10.794130 2021-03-09 17:55:17.133: INFO @log_variables: train gender_accuracy mean: 0.827836 2021-03-09 17:55:17.133: INFO @log_variables: train gender_confidence/loss nanmean: 0.074195 2021-03-09 17:55:17.133: INFO @log_variables: train gender_confidence/accuracy mean: 0.741030 2021-03-09 17:55:17.133: INFO @log_variables: train age_confidence/loss mean: 0.052643 2021-03-09 17:55:17.133: INFO @log_variables: train age_confidence/accuracy mean: 0.708623 2021-03-09 17:55:17.134: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:55:17.137: INFO @metrics_hook: train age_mae: 10.794 +-0.168 (13824) 2021-03-09 17:55:17.139: INFO @metrics_hook: train gender_accuracy: 0.828 +-0.006 (13824) 2021-03-09 17:55:19.371: INFO @decay_lr : LR updated to `0.00019396751` 2021-03-09 17:55:19.373: INFO @log_profile : T train: 18.561228 2021-03-09 17:55:19.373: INFO @log_profile : T read data: 0.522914 2021-03-09 17:55:19.373: INFO @log_profile : T hooks: 2.712707 2021-03-09 17:55:19.373: INFO @main_loop : Epoch 87 done 2021-03-09 17:55:19.373: INFO @main_loop : Training epoch 88 2021-03-09 17:55:39.593: INFO @log_variables: train loss nanmean: 1.511012 2021-03-09 17:55:39.595: INFO @log_variables: train age_loss mean: 11.396464 2021-03-09 17:55:39.596: INFO @log_variables: train gender_loss mean: 0.381535 2021-03-09 17:55:39.597: INFO @log_variables: train age_mae mean: 10.742668 2021-03-09 17:55:39.600: INFO @log_variables: train gender_accuracy mean: 0.830946 2021-03-09 17:55:39.601: INFO @log_variables: train gender_confidence/loss nanmean: 0.075246 2021-03-09 17:55:39.603: INFO @log_variables: train gender_confidence/accuracy mean: 0.732711 2021-03-09 17:55:39.604: INFO @log_variables: train age_confidence/loss mean: 0.052875 2021-03-09 17:55:39.605: INFO @log_variables: train age_confidence/accuracy mean: 0.701100 2021-03-09 17:55:39.607: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:55:39.609: INFO @metrics_hook: train age_mae: 10.743 +-0.171 (13824) 2021-03-09 17:55:39.611: INFO @metrics_hook: train gender_accuracy: 0.831 +-0.006 (13824) 2021-03-09 17:55:43.837: INFO @decay_lr : LR updated to `0.00019299767` 2021-03-09 17:55:43.844: INFO @log_profile : T train: 19.252299 2021-03-09 17:55:43.846: INFO @log_profile : T read data: 0.379037 2021-03-09 17:55:43.847: INFO @log_profile : T hooks: 4.784440 2021-03-09 17:55:43.848: INFO @main_loop : Epoch 88 done 2021-03-09 17:55:43.849: INFO @main_loop : Training epoch 89 2021-03-09 17:56:03.223: INFO @log_variables: train loss nanmean: 1.493234 2021-03-09 17:56:03.224: INFO @log_variables: train age_loss mean: 11.299581 2021-03-09 17:56:03.224: INFO @log_variables: train gender_loss mean: 0.372786 2021-03-09 17:56:03.224: INFO @log_variables: train age_mae mean: 10.650519 2021-03-09 17:56:03.224: INFO @log_variables: train gender_accuracy mean: 0.833116 2021-03-09 17:56:03.224: INFO @log_variables: train gender_confidence/loss nanmean: 0.074695 2021-03-09 17:56:03.224: INFO @log_variables: train gender_confidence/accuracy mean: 0.740958 2021-03-09 17:56:03.224: INFO @log_variables: train age_confidence/loss mean: 0.052408 2021-03-09 17:56:03.224: INFO @log_variables: train age_confidence/accuracy mean: 0.704572 2021-03-09 17:56:03.224: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:56:03.226: INFO @metrics_hook: train age_mae: 10.651 +-0.169 (13824) 2021-03-09 17:56:03.228: INFO @metrics_hook: train gender_accuracy: 0.833 +-0.006 (13824) 2021-03-09 17:56:05.435: INFO @decay_lr : LR updated to `0.00019203269` 2021-03-09 17:56:05.436: INFO @log_profile : T train: 18.426555 2021-03-09 17:56:05.436: INFO @log_profile : T read data: 0.373172 2021-03-09 17:56:05.436: INFO @log_profile : T hooks: 2.732289 2021-03-09 17:56:05.436: INFO @main_loop : Epoch 89 done 2021-03-09 17:56:05.436: INFO @main_loop : Training epoch 90 2021-03-09 17:56:24.999: INFO @log_variables: train loss nanmean: 1.509016 2021-03-09 17:56:24.999: INFO @log_variables: train age_loss mean: 11.468945 2021-03-09 17:56:25.000: INFO @log_variables: train gender_loss mean: 0.372954 2021-03-09 17:56:25.000: INFO @log_variables: train age_mae mean: 10.813768 2021-03-09 17:56:25.000: INFO @log_variables: train gender_accuracy mean: 0.832248 2021-03-09 17:56:25.000: INFO @log_variables: train gender_confidence/loss nanmean: 0.073990 2021-03-09 17:56:25.000: INFO @log_variables: train gender_confidence/accuracy mean: 0.740162 2021-03-09 17:56:25.000: INFO @log_variables: train age_confidence/loss mean: 0.053345 2021-03-09 17:56:25.000: INFO @log_variables: train age_confidence/accuracy mean: 0.699942 2021-03-09 17:56:25.000: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:56:25.002: INFO @metrics_hook: train age_mae: 10.814 +-0.172 (13824) 2021-03-09 17:56:25.005: INFO @metrics_hook: train gender_accuracy: 0.832 +-0.006 (13824) 2021-03-09 17:56:27.698: INFO @decay_lr : LR updated to `0.00019107253` 2021-03-09 17:56:27.699: INFO @log_profile : T train: 18.508928 2021-03-09 17:56:27.699: INFO @log_profile : T read data: 0.494011 2021-03-09 17:56:27.699: INFO @log_profile : T hooks: 3.207490 2021-03-09 17:56:27.699: INFO @main_loop : Epoch 90 done 2021-03-09 17:56:27.700: INFO @main_loop : Training epoch 91 2021-03-09 17:56:47.275: INFO @log_variables: train loss nanmean: 1.496017 2021-03-09 17:56:47.275: INFO @log_variables: train age_loss mean: 11.229629 2021-03-09 17:56:47.275: INFO @log_variables: train gender_loss mean: 0.382913 2021-03-09 17:56:47.275: INFO @log_variables: train age_mae mean: 10.576093 2021-03-09 17:56:47.275: INFO @log_variables: train gender_accuracy mean: 0.827679 2021-03-09 17:56:47.275: INFO @log_variables: train gender_confidence/loss nanmean: 0.074095 2021-03-09 17:56:47.276: INFO @log_variables: train gender_confidence/accuracy mean: 0.736020 2021-03-09 17:56:47.276: INFO @log_variables: train age_confidence/loss mean: 0.052944 2021-03-09 17:56:47.276: INFO @log_variables: train age_confidence/accuracy mean: 0.701657 2021-03-09 17:56:47.276: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:56:47.278: INFO @metrics_hook: train age_mae: 10.576 +-0.167 (13823) 2021-03-09 17:56:47.279: INFO @metrics_hook: train gender_accuracy: 0.828 +-0.006 (13823) 2021-03-09 17:56:49.807: INFO @decay_lr : LR updated to `0.00019011716` 2021-03-09 17:56:49.809: INFO @log_profile : T train: 18.679997 2021-03-09 17:56:49.809: INFO @log_profile : T read data: 0.380801 2021-03-09 17:56:49.809: INFO @log_profile : T hooks: 2.995784 2021-03-09 17:56:49.809: INFO @main_loop : Epoch 91 done 2021-03-09 17:56:49.809: INFO @main_loop : Training epoch 92 2021-03-09 17:57:09.298: INFO @log_variables: train loss nanmean: 1.486957 2021-03-09 17:57:09.298: INFO @log_variables: train age_loss mean: 11.239626 2021-03-09 17:57:09.298: INFO @log_variables: train gender_loss mean: 0.372723 2021-03-09 17:57:09.298: INFO @log_variables: train age_mae mean: 10.594661 2021-03-09 17:57:09.298: INFO @log_variables: train gender_accuracy mean: 0.831959 2021-03-09 17:57:09.298: INFO @log_variables: train gender_confidence/loss nanmean: 0.073630 2021-03-09 17:57:09.298: INFO @log_variables: train gender_confidence/accuracy mean: 0.744213 2021-03-09 17:57:09.298: INFO @log_variables: train age_confidence/loss mean: 0.052703 2021-03-09 17:57:09.299: INFO @log_variables: train age_confidence/accuracy mean: 0.702185 2021-03-09 17:57:09.299: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:57:09.300: INFO @metrics_hook: train age_mae: 10.595 +-0.169 (13824) 2021-03-09 17:57:09.302: INFO @metrics_hook: train gender_accuracy: 0.832 +-0.006 (13824) 2021-03-09 17:57:11.660: INFO @decay_lr : LR updated to `0.00018916657` 2021-03-09 17:57:11.661: INFO @log_profile : T train: 18.582541 2021-03-09 17:57:11.661: INFO @log_profile : T read data: 0.367497 2021-03-09 17:57:11.661: INFO @log_profile : T hooks: 2.848937 2021-03-09 17:57:11.661: INFO @main_loop : Epoch 92 done 2021-03-09 17:57:11.661: INFO @main_loop : Training epoch 93 2021-03-09 17:57:31.202: INFO @log_variables: train loss nanmean: 1.486286 2021-03-09 17:57:31.203: INFO @log_variables: train age_loss mean: 11.226923 2021-03-09 17:57:31.203: INFO @log_variables: train gender_loss mean: 0.372423 2021-03-09 17:57:31.203: INFO @log_variables: train age_mae mean: 10.576443 2021-03-09 17:57:31.203: INFO @log_variables: train gender_accuracy mean: 0.833406 2021-03-09 17:57:31.203: INFO @log_variables: train gender_confidence/loss nanmean: 0.074391 2021-03-09 17:57:31.203: INFO @log_variables: train gender_confidence/accuracy mean: 0.743128 2021-03-09 17:57:31.203: INFO @log_variables: train age_confidence/loss mean: 0.052699 2021-03-09 17:57:31.203: INFO @log_variables: train age_confidence/accuracy mean: 0.702691 2021-03-09 17:57:31.203: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:57:31.205: INFO @metrics_hook: train age_mae: 10.576 +-0.166 (13824) 2021-03-09 17:57:31.207: INFO @metrics_hook: train gender_accuracy: 0.833 +-0.006 (13824) 2021-03-09 17:57:33.750: INFO @decay_lr : LR updated to `0.00018822074` 2021-03-09 17:57:33.752: INFO @log_profile : T train: 18.537008 2021-03-09 17:57:33.752: INFO @log_profile : T read data: 0.482645 2021-03-09 17:57:33.752: INFO @log_profile : T hooks: 3.020424 2021-03-09 17:57:33.753: INFO @main_loop : Epoch 93 done 2021-03-09 17:57:33.753: INFO @main_loop : Training epoch 94 2021-03-09 17:57:56.032: INFO @log_variables: train loss nanmean: 1.480445 2021-03-09 17:57:56.033: INFO @log_variables: train age_loss mean: 11.196822 2021-03-09 17:57:56.033: INFO @log_variables: train gender_loss mean: 0.368936 2021-03-09 17:57:56.033: INFO @log_variables: train age_mae mean: 10.548428 2021-03-09 17:57:56.033: INFO @log_variables: train gender_accuracy mean: 0.834563 2021-03-09 17:57:56.033: INFO @log_variables: train gender_confidence/loss nanmean: 0.074042 2021-03-09 17:57:56.033: INFO @log_variables: train gender_confidence/accuracy mean: 0.745443 2021-03-09 17:57:56.033: INFO @log_variables: train age_confidence/loss mean: 0.053113 2021-03-09 17:57:56.033: INFO @log_variables: train age_confidence/accuracy mean: 0.701678 2021-03-09 17:57:56.033: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:57:56.035: INFO @metrics_hook: train age_mae: 10.548 +-0.166 (13824) 2021-03-09 17:57:56.057: INFO @metrics_hook: train gender_accuracy: 0.835 +-0.006 (13824) 2021-03-09 17:57:59.561: INFO @decay_lr : LR updated to `0.00018727964` 2021-03-09 17:57:59.564: INFO @log_profile : T train: 21.129691 2021-03-09 17:57:59.564: INFO @log_profile : T read data: 0.578182 2021-03-09 17:57:59.565: INFO @log_profile : T hooks: 4.046546 2021-03-09 17:57:59.565: INFO @main_loop : Epoch 94 done 2021-03-09 17:57:59.565: INFO @main_loop : Training epoch 95 2021-03-09 17:58:23.129: INFO @log_variables: train loss nanmean: 1.472412 2021-03-09 17:58:23.144: INFO @log_variables: train age_loss mean: 11.113308 2021-03-09 17:58:23.145: INFO @log_variables: train gender_loss mean: 0.369081 2021-03-09 17:58:23.145: INFO @log_variables: train age_mae mean: 10.464083 2021-03-09 17:58:23.145: INFO @log_variables: train gender_accuracy mean: 0.833550 2021-03-09 17:58:23.145: INFO @log_variables: train gender_confidence/loss nanmean: 0.073195 2021-03-09 17:58:23.145: INFO @log_variables: train gender_confidence/accuracy mean: 0.743562 2021-03-09 17:58:23.145: INFO @log_variables: train age_confidence/loss mean: 0.053388 2021-03-09 17:58:23.145: INFO @log_variables: train age_confidence/accuracy mean: 0.695819 2021-03-09 17:58:23.145: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:58:23.148: INFO @metrics_hook: train age_mae: 10.464 +-0.166 (13824) 2021-03-09 17:58:23.151: INFO @metrics_hook: train gender_accuracy: 0.834 +-0.006 (13824) 2021-03-09 17:58:26.973: INFO @decay_lr : LR updated to `0.00018634324` 2021-03-09 17:58:26.974: INFO @log_profile : T train: 22.550377 2021-03-09 17:58:26.974: INFO @log_profile : T read data: 0.465294 2021-03-09 17:58:26.975: INFO @log_profile : T hooks: 4.338593 2021-03-09 17:58:26.975: INFO @main_loop : Epoch 95 done 2021-03-09 17:58:26.975: INFO @main_loop : Training epoch 96 2021-03-09 17:58:48.162: INFO @log_variables: train loss nanmean: 1.479104 2021-03-09 17:58:48.163: INFO @log_variables: train age_loss mean: 11.165801 2021-03-09 17:58:48.163: INFO @log_variables: train gender_loss mean: 0.371021 2021-03-09 17:58:48.163: INFO @log_variables: train age_mae mean: 10.519006 2021-03-09 17:58:48.163: INFO @log_variables: train gender_accuracy mean: 0.831887 2021-03-09 17:58:48.163: INFO @log_variables: train gender_confidence/loss nanmean: 0.073523 2021-03-09 17:58:48.163: INFO @log_variables: train gender_confidence/accuracy mean: 0.741970 2021-03-09 17:58:48.163: INFO @log_variables: train age_confidence/loss mean: 0.053217 2021-03-09 17:58:48.163: INFO @log_variables: train age_confidence/accuracy mean: 0.699797 2021-03-09 17:58:48.163: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:58:48.165: INFO @metrics_hook: train age_mae: 10.519 +-0.168 (13824) 2021-03-09 17:58:48.167: INFO @metrics_hook: train gender_accuracy: 0.832 +-0.006 (13824) 2021-03-09 17:58:51.106: INFO @decay_lr : LR updated to `0.00018541153` 2021-03-09 17:58:51.108: INFO @log_profile : T train: 19.888991 2021-03-09 17:58:51.108: INFO @log_profile : T read data: 0.702909 2021-03-09 17:58:51.108: INFO @log_profile : T hooks: 3.480800 2021-03-09 17:58:51.108: INFO @main_loop : Epoch 96 done 2021-03-09 17:58:51.108: INFO @main_loop : Training epoch 97 2021-03-09 17:59:12.559: INFO @log_variables: train loss nanmean: 1.460137 2021-03-09 17:59:12.560: INFO @log_variables: train age_loss mean: 10.978970 2021-03-09 17:59:12.560: INFO @log_variables: train gender_loss mean: 0.368109 2021-03-09 17:59:12.560: INFO @log_variables: train age_mae mean: 10.337899 2021-03-09 17:59:12.560: INFO @log_variables: train gender_accuracy mean: 0.835503 2021-03-09 17:59:12.560: INFO @log_variables: train gender_confidence/loss nanmean: 0.074020 2021-03-09 17:59:12.560: INFO @log_variables: train gender_confidence/accuracy mean: 0.741681 2021-03-09 17:59:12.560: INFO @log_variables: train age_confidence/loss mean: 0.053384 2021-03-09 17:59:12.560: INFO @log_variables: train age_confidence/accuracy mean: 0.698423 2021-03-09 17:59:12.560: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:59:12.561: INFO @metrics_hook: train age_mae: 10.338 +-0.166 (13824) 2021-03-09 17:59:12.563: INFO @metrics_hook: train gender_accuracy: 0.836 +-0.006 (13824) 2021-03-09 17:59:15.369: INFO @decay_lr : LR updated to `0.00018448447` 2021-03-09 17:59:15.373: INFO @log_profile : T train: 20.365529 2021-03-09 17:59:15.373: INFO @log_profile : T read data: 0.527606 2021-03-09 17:59:15.375: INFO @log_profile : T hooks: 3.316590 2021-03-09 17:59:15.376: INFO @main_loop : Epoch 97 done 2021-03-09 17:59:15.377: INFO @main_loop : Training epoch 98 2021-03-09 17:59:34.938: INFO @log_variables: train loss nanmean: 1.492899 2021-03-09 17:59:34.938: INFO @log_variables: train age_loss mean: 11.364782 2021-03-09 17:59:34.938: INFO @log_variables: train gender_loss mean: 0.367340 2021-03-09 17:59:34.938: INFO @log_variables: train age_mae mean: 10.714531 2021-03-09 17:59:34.938: INFO @log_variables: train gender_accuracy mean: 0.834201 2021-03-09 17:59:34.938: INFO @log_variables: train gender_confidence/loss nanmean: 0.073248 2021-03-09 17:59:34.938: INFO @log_variables: train gender_confidence/accuracy mean: 0.746672 2021-03-09 17:59:34.938: INFO @log_variables: train age_confidence/loss mean: 0.052544 2021-03-09 17:59:34.938: INFO @log_variables: train age_confidence/accuracy mean: 0.705078 2021-03-09 17:59:34.939: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:59:34.940: INFO @metrics_hook: train age_mae: 10.715 +-0.170 (13824) 2021-03-09 17:59:34.942: INFO @metrics_hook: train gender_accuracy: 0.834 +-0.006 (13824) 2021-03-09 17:59:37.312: INFO @decay_lr : LR updated to `0.00018356205` 2021-03-09 17:59:37.313: INFO @log_profile : T train: 18.645489 2021-03-09 17:59:37.313: INFO @log_profile : T read data: 0.353159 2021-03-09 17:59:37.313: INFO @log_profile : T hooks: 2.884334 2021-03-09 17:59:37.313: INFO @main_loop : Epoch 98 done 2021-03-09 17:59:37.313: INFO @main_loop : Training epoch 99 2021-03-09 17:59:56.577: INFO @log_variables: train loss nanmean: 1.462934 2021-03-09 17:59:56.577: INFO @log_variables: train age_loss mean: 11.064172 2021-03-09 17:59:56.577: INFO @log_variables: train gender_loss mean: 0.363768 2021-03-09 17:59:56.577: INFO @log_variables: train age_mae mean: 10.420427 2021-03-09 17:59:56.577: INFO @log_variables: train gender_accuracy mean: 0.837529 2021-03-09 17:59:56.577: INFO @log_variables: train gender_confidence/loss nanmean: 0.073397 2021-03-09 17:59:56.577: INFO @log_variables: train gender_confidence/accuracy mean: 0.747034 2021-03-09 17:59:56.577: INFO @log_variables: train age_confidence/loss mean: 0.053005 2021-03-09 17:59:56.577: INFO @log_variables: train age_confidence/accuracy mean: 0.703993 2021-03-09 17:59:56.577: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 17:59:56.579: INFO @metrics_hook: train age_mae: 10.420 +-0.165 (13824) 2021-03-09 17:59:56.580: INFO @metrics_hook: train gender_accuracy: 0.838 +-0.006 (13824) 2021-03-09 17:59:58.815: INFO @decay_lr : LR updated to `0.00018264425` 2021-03-09 17:59:58.817: INFO @log_profile : T train: 18.353939 2021-03-09 17:59:58.817: INFO @log_profile : T read data: 0.349824 2021-03-09 17:59:58.817: INFO @log_profile : T hooks: 2.745268 2021-03-09 17:59:58.817: INFO @main_loop : Epoch 99 done 2021-03-09 17:59:58.817: INFO @main_loop : Training epoch 100 2021-03-09 18:00:18.212: INFO @log_variables: train loss nanmean: 1.469933 2021-03-09 18:00:18.212: INFO @log_variables: train age_loss mean: 11.199641 2021-03-09 18:00:18.212: INFO @log_variables: train gender_loss mean: 0.358253 2021-03-09 18:00:18.213: INFO @log_variables: train age_mae mean: 10.559407 2021-03-09 18:00:18.213: INFO @log_variables: train gender_accuracy mean: 0.840929 2021-03-09 18:00:18.213: INFO @log_variables: train gender_confidence/loss nanmean: 0.073446 2021-03-09 18:00:18.213: INFO @log_variables: train gender_confidence/accuracy mean: 0.743417 2021-03-09 18:00:18.213: INFO @log_variables: train age_confidence/loss mean: 0.052654 2021-03-09 18:00:18.213: INFO @log_variables: train age_confidence/accuracy mean: 0.708984 2021-03-09 18:00:18.213: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:00:18.214: INFO @metrics_hook: train age_mae: 10.559 +-0.167 (13824) 2021-03-09 18:00:18.215: INFO @metrics_hook: train gender_accuracy: 0.841 +-0.006 (13824) 2021-03-09 18:00:20.375: INFO @decay_lr : LR updated to `0.00018173103` 2021-03-09 18:00:20.376: INFO @log_profile : T train: 18.377719 2021-03-09 18:00:20.376: INFO @log_profile : T read data: 0.461627 2021-03-09 18:00:20.376: INFO @log_profile : T hooks: 2.667761 2021-03-09 18:00:20.376: INFO @main_loop : Epoch 100 done 2021-03-09 18:00:20.376: INFO @main_loop : Training epoch 101 2021-03-09 18:00:39.291: INFO @log_variables: train loss nanmean: 1.461136 2021-03-09 18:00:39.291: INFO @log_variables: train age_loss mean: 11.017879 2021-03-09 18:00:39.291: INFO @log_variables: train gender_loss mean: 0.365472 2021-03-09 18:00:39.292: INFO @log_variables: train age_mae mean: 10.374395 2021-03-09 18:00:39.292: INFO @log_variables: train gender_accuracy mean: 0.834274 2021-03-09 18:00:39.292: INFO @log_variables: train gender_confidence/loss nanmean: 0.073330 2021-03-09 18:00:39.292: INFO @log_variables: train gender_confidence/accuracy mean: 0.741175 2021-03-09 18:00:39.292: INFO @log_variables: train age_confidence/loss mean: 0.053933 2021-03-09 18:00:39.292: INFO @log_variables: train age_confidence/accuracy mean: 0.692274 2021-03-09 18:00:39.292: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:00:39.295: INFO @metrics_hook: train age_mae: 10.374 +-0.168 (13824) 2021-03-09 18:00:39.297: INFO @metrics_hook: train gender_accuracy: 0.834 +-0.006 (13824) 2021-03-09 18:00:41.466: INFO @decay_lr : LR updated to `0.00018082238` 2021-03-09 18:00:41.468: INFO @log_profile : T train: 18.024362 2021-03-09 18:00:41.468: INFO @log_profile : T read data: 0.336564 2021-03-09 18:00:41.468: INFO @log_profile : T hooks: 2.680228 2021-03-09 18:00:41.468: INFO @main_loop : Epoch 101 done 2021-03-09 18:00:41.468: INFO @main_loop : Training epoch 102 2021-03-09 18:01:01.322: INFO @log_variables: train loss nanmean: 1.470312 2021-03-09 18:01:01.322: INFO @log_variables: train age_loss mean: 11.161843 2021-03-09 18:01:01.322: INFO @log_variables: train gender_loss mean: 0.362600 2021-03-09 18:01:01.322: INFO @log_variables: train age_mae mean: 10.517250 2021-03-09 18:01:01.328: INFO @log_variables: train gender_accuracy mean: 0.838252 2021-03-09 18:01:01.331: INFO @log_variables: train gender_confidence/loss nanmean: 0.072844 2021-03-09 18:01:01.332: INFO @log_variables: train gender_confidence/accuracy mean: 0.749783 2021-03-09 18:01:01.333: INFO @log_variables: train age_confidence/loss mean: 0.053120 2021-03-09 18:01:01.333: INFO @log_variables: train age_confidence/accuracy mean: 0.698929 2021-03-09 18:01:01.333: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:01:01.335: INFO @metrics_hook: train age_mae: 10.517 +-0.169 (13824) 2021-03-09 18:01:01.338: INFO @metrics_hook: train gender_accuracy: 0.838 +-0.006 (13824) 2021-03-09 18:01:04.130: INFO @decay_lr : LR updated to `0.00017991826` 2021-03-09 18:01:04.135: INFO @log_profile : T train: 18.898133 2021-03-09 18:01:04.136: INFO @log_profile : T read data: 0.411352 2021-03-09 18:01:04.138: INFO @log_profile : T hooks: 3.305203 2021-03-09 18:01:04.139: INFO @main_loop : Epoch 102 done 2021-03-09 18:01:04.140: INFO @main_loop : Training epoch 103 2021-03-09 18:01:26.090: INFO @log_variables: train loss nanmean: 1.440040 2021-03-09 18:01:26.090: INFO @log_variables: train age_loss mean: 10.906447 2021-03-09 18:01:26.090: INFO @log_variables: train gender_loss mean: 0.354693 2021-03-09 18:01:26.090: INFO @log_variables: train age_mae mean: 10.265899 2021-03-09 18:01:26.090: INFO @log_variables: train gender_accuracy mean: 0.840929 2021-03-09 18:01:26.090: INFO @log_variables: train gender_confidence/loss nanmean: 0.071957 2021-03-09 18:01:26.090: INFO @log_variables: train gender_confidence/accuracy mean: 0.750289 2021-03-09 18:01:26.090: INFO @log_variables: train age_confidence/loss mean: 0.054139 2021-03-09 18:01:26.090: INFO @log_variables: train age_confidence/accuracy mean: 0.695312 2021-03-09 18:01:26.091: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:01:26.092: INFO @metrics_hook: train age_mae: 10.266 +-0.166 (13824) 2021-03-09 18:01:26.094: INFO @metrics_hook: train gender_accuracy: 0.841 +-0.006 (13824) 2021-03-09 18:01:29.038: INFO @decay_lr : LR updated to `0.00017901868` 2021-03-09 18:01:29.040: INFO @log_profile : T train: 20.576644 2021-03-09 18:01:29.040: INFO @log_profile : T read data: 0.782334 2021-03-09 18:01:29.040: INFO @log_profile : T hooks: 3.477622 2021-03-09 18:01:29.040: INFO @main_loop : Epoch 103 done 2021-03-09 18:01:29.040: INFO @main_loop : Training epoch 104 2021-03-09 18:01:50.906: INFO @log_variables: train loss nanmean: 1.432847 2021-03-09 18:01:50.907: INFO @log_variables: train age_loss mean: 10.800848 2021-03-09 18:01:50.907: INFO @log_variables: train gender_loss mean: 0.356940 2021-03-09 18:01:50.907: INFO @log_variables: train age_mae mean: 10.162467 2021-03-09 18:01:50.907: INFO @log_variables: train gender_accuracy mean: 0.842509 2021-03-09 18:01:50.907: INFO @log_variables: train gender_confidence/loss nanmean: 0.073290 2021-03-09 18:01:50.907: INFO @log_variables: train gender_confidence/accuracy mean: 0.752225 2021-03-09 18:01:50.907: INFO @log_variables: train age_confidence/loss mean: 0.053171 2021-03-09 18:01:50.907: INFO @log_variables: train age_confidence/accuracy mean: 0.702597 2021-03-09 18:01:50.907: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:01:50.909: INFO @metrics_hook: train age_mae: 10.162 +-0.163 (13823) 2021-03-09 18:01:50.911: INFO @metrics_hook: train gender_accuracy: 0.843 +-0.006 (13823) 2021-03-09 18:01:53.598: INFO @decay_lr : LR updated to `0.00017812359` 2021-03-09 18:01:53.601: INFO @log_profile : T train: 20.781317 2021-03-09 18:01:53.601: INFO @log_profile : T read data: 0.506937 2021-03-09 18:01:53.601: INFO @log_profile : T hooks: 3.214895 2021-03-09 18:01:53.601: INFO @main_loop : Epoch 104 done 2021-03-09 18:01:53.601: INFO @main_loop : Training epoch 105 2021-03-09 18:02:13.265: INFO @log_variables: train loss nanmean: 1.436904 2021-03-09 18:02:13.265: INFO @log_variables: train age_loss mean: 10.908960 2021-03-09 18:02:13.265: INFO @log_variables: train gender_loss mean: 0.350853 2021-03-09 18:02:13.265: INFO @log_variables: train age_mae mean: 10.269340 2021-03-09 18:02:13.265: INFO @log_variables: train gender_accuracy mean: 0.846426 2021-03-09 18:02:13.265: INFO @log_variables: train gender_confidence/loss nanmean: 0.072530 2021-03-09 18:02:13.265: INFO @log_variables: train gender_confidence/accuracy mean: 0.748192 2021-03-09 18:02:13.265: INFO @log_variables: train age_confidence/loss mean: 0.053692 2021-03-09 18:02:13.266: INFO @log_variables: train age_confidence/accuracy mean: 0.698495 2021-03-09 18:02:13.266: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:02:13.268: INFO @metrics_hook: train age_mae: 10.269 +-0.164 (13824) 2021-03-09 18:02:13.270: INFO @metrics_hook: train gender_accuracy: 0.846 +-0.006 (13824) 2021-03-09 18:02:15.796: INFO @decay_lr : LR updated to `0.00017723297` 2021-03-09 18:02:15.798: INFO @log_profile : T train: 18.727186 2021-03-09 18:02:15.798: INFO @log_profile : T read data: 0.377186 2021-03-09 18:02:15.798: INFO @log_profile : T hooks: 3.038838 2021-03-09 18:02:15.798: INFO @main_loop : Epoch 105 done 2021-03-09 18:02:15.798: INFO @main_loop : Training epoch 106 2021-03-09 18:02:34.809: INFO @log_variables: train loss nanmean: 1.451027 2021-03-09 18:02:34.809: INFO @log_variables: train age_loss mean: 11.032263 2021-03-09 18:02:34.810: INFO @log_variables: train gender_loss mean: 0.353340 2021-03-09 18:02:34.810: INFO @log_variables: train age_mae mean: 10.390865 2021-03-09 18:02:34.810: INFO @log_variables: train gender_accuracy mean: 0.844473 2021-03-09 18:02:34.810: INFO @log_variables: train gender_confidence/loss nanmean: 0.073364 2021-03-09 18:02:34.810: INFO @log_variables: train gender_confidence/accuracy mean: 0.749060 2021-03-09 18:02:34.810: INFO @log_variables: train age_confidence/loss mean: 0.053512 2021-03-09 18:02:34.810: INFO @log_variables: train age_confidence/accuracy mean: 0.696615 2021-03-09 18:02:34.810: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:02:34.812: INFO @metrics_hook: train age_mae: 10.391 +-0.167 (13824) 2021-03-09 18:02:34.814: INFO @metrics_hook: train gender_accuracy: 0.844 +-0.006 (13824) 2021-03-09 18:02:36.800: INFO @decay_lr : LR updated to `0.0001763468` 2021-03-09 18:02:36.801: INFO @log_profile : T train: 17.992764 2021-03-09 18:02:36.801: INFO @log_profile : T read data: 0.461571 2021-03-09 18:02:36.801: INFO @log_profile : T hooks: 2.498497 2021-03-09 18:02:36.802: INFO @main_loop : Epoch 106 done 2021-03-09 18:02:36.802: INFO @main_loop : Training epoch 107 2021-03-09 18:02:55.987: INFO @log_variables: train loss nanmean: 1.446011 2021-03-09 18:02:55.987: INFO @log_variables: train age_loss mean: 10.908586 2021-03-09 18:02:55.987: INFO @log_variables: train gender_loss mean: 0.359520 2021-03-09 18:02:55.987: INFO @log_variables: train age_mae mean: 10.268568 2021-03-09 18:02:55.987: INFO @log_variables: train gender_accuracy mean: 0.842014 2021-03-09 18:02:55.987: INFO @log_variables: train gender_confidence/loss nanmean: 0.073516 2021-03-09 18:02:55.987: INFO @log_variables: train gender_confidence/accuracy mean: 0.744792 2021-03-09 18:02:55.988: INFO @log_variables: train age_confidence/loss mean: 0.053969 2021-03-09 18:02:55.988: INFO @log_variables: train age_confidence/accuracy mean: 0.693938 2021-03-09 18:02:55.988: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:02:55.990: INFO @metrics_hook: train age_mae: 10.269 +-0.166 (13824) 2021-03-09 18:02:55.992: INFO @metrics_hook: train gender_accuracy: 0.842 +-0.006 (13824) 2021-03-09 18:02:58.022: INFO @decay_lr : LR updated to `0.00017546507` 2021-03-09 18:02:58.024: INFO @log_profile : T train: 18.321425 2021-03-09 18:02:58.024: INFO @log_profile : T read data: 0.317425 2021-03-09 18:02:58.024: INFO @log_profile : T hooks: 2.532974 2021-03-09 18:02:58.024: INFO @main_loop : Epoch 107 done 2021-03-09 18:02:58.024: INFO @main_loop : Training epoch 108 2021-03-09 18:03:16.800: INFO @log_variables: train loss nanmean: 1.433977 2021-03-09 18:03:16.800: INFO @log_variables: train age_loss mean: 10.821097 2021-03-09 18:03:16.800: INFO @log_variables: train gender_loss mean: 0.355939 2021-03-09 18:03:16.800: INFO @log_variables: train age_mae mean: 10.186799 2021-03-09 18:03:16.800: INFO @log_variables: train gender_accuracy mean: 0.839844 2021-03-09 18:03:16.800: INFO @log_variables: train gender_confidence/loss nanmean: 0.072512 2021-03-09 18:03:16.801: INFO @log_variables: train gender_confidence/accuracy mean: 0.749204 2021-03-09 18:03:16.801: INFO @log_variables: train age_confidence/loss mean: 0.054148 2021-03-09 18:03:16.801: INFO @log_variables: train age_confidence/accuracy mean: 0.693938 2021-03-09 18:03:16.801: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:03:16.804: INFO @metrics_hook: train age_mae: 10.187 +-0.166 (13824) 2021-03-09 18:03:16.807: INFO @metrics_hook: train gender_accuracy: 0.840 +-0.006 (13824) 2021-03-09 18:03:18.796: INFO @decay_lr : LR updated to `0.00017458775` 2021-03-09 18:03:18.798: INFO @log_profile : T train: 17.914052 2021-03-09 18:03:18.798: INFO @log_profile : T read data: 0.301677 2021-03-09 18:03:18.798: INFO @log_profile : T hooks: 2.508491 2021-03-09 18:03:18.798: INFO @main_loop : Epoch 108 done 2021-03-09 18:03:18.798: INFO @main_loop : Training epoch 109 2021-03-09 18:03:37.966: INFO @log_variables: train loss nanmean: 1.443552 2021-03-09 18:03:37.966: INFO @log_variables: train age_loss mean: 11.000099 2021-03-09 18:03:37.966: INFO @log_variables: train gender_loss mean: 0.348498 2021-03-09 18:03:37.966: INFO @log_variables: train age_mae mean: 10.369604 2021-03-09 18:03:37.966: INFO @log_variables: train gender_accuracy mean: 0.846644 2021-03-09 18:03:37.967: INFO @log_variables: train gender_confidence/loss nanmean: 0.072669 2021-03-09 18:03:37.967: INFO @log_variables: train gender_confidence/accuracy mean: 0.747902 2021-03-09 18:03:37.967: INFO @log_variables: train age_confidence/loss mean: 0.054057 2021-03-09 18:03:37.967: INFO @log_variables: train age_confidence/accuracy mean: 0.690104 2021-03-09 18:03:37.967: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:03:37.969: INFO @metrics_hook: train age_mae: 10.370 +-0.168 (13824) 2021-03-09 18:03:37.971: INFO @metrics_hook: train gender_accuracy: 0.847 +-0.006 (13824) 2021-03-09 18:03:39.992: INFO @decay_lr : LR updated to `0.00017371481` 2021-03-09 18:03:39.993: INFO @log_profile : T train: 18.147099 2021-03-09 18:03:39.993: INFO @log_profile : T read data: 0.446537 2021-03-09 18:03:39.993: INFO @log_profile : T hooks: 2.551863 2021-03-09 18:03:39.993: INFO @main_loop : Epoch 109 done 2021-03-09 18:03:39.993: INFO @main_loop : Training epoch 110 2021-03-09 18:03:59.207: INFO @log_variables: train loss nanmean: 1.432989 2021-03-09 18:03:59.208: INFO @log_variables: train age_loss mean: 10.791539 2021-03-09 18:03:59.208: INFO @log_variables: train gender_loss mean: 0.356871 2021-03-09 18:03:59.208: INFO @log_variables: train age_mae mean: 10.165465 2021-03-09 18:03:59.208: INFO @log_variables: train gender_accuracy mean: 0.843895 2021-03-09 18:03:59.208: INFO @log_variables: train gender_confidence/loss nanmean: 0.073671 2021-03-09 18:03:59.208: INFO @log_variables: train gender_confidence/accuracy mean: 0.744936 2021-03-09 18:03:59.208: INFO @log_variables: train age_confidence/loss mean: 0.053842 2021-03-09 18:03:59.208: INFO @log_variables: train age_confidence/accuracy mean: 0.694300 2021-03-09 18:03:59.208: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:03:59.210: INFO @metrics_hook: train age_mae: 10.165 +-0.165 (13824) 2021-03-09 18:03:59.212: INFO @metrics_hook: train gender_accuracy: 0.844 +-0.006 (13824) 2021-03-09 18:04:01.845: INFO @decay_lr : LR updated to `0.00017284624` 2021-03-09 18:04:01.846: INFO @log_profile : T train: 18.323682 2021-03-09 18:04:01.846: INFO @log_profile : T read data: 0.346346 2021-03-09 18:04:01.846: INFO @log_profile : T hooks: 3.131438 2021-03-09 18:04:01.846: INFO @main_loop : Epoch 110 done 2021-03-09 18:04:01.846: INFO @main_loop : Training epoch 111 2021-03-09 18:04:21.160: INFO @log_variables: train loss nanmean: 1.428166 2021-03-09 18:04:21.160: INFO @log_variables: train age_loss mean: 10.798602 2021-03-09 18:04:21.160: INFO @log_variables: train gender_loss mean: 0.350306 2021-03-09 18:04:21.160: INFO @log_variables: train age_mae mean: 10.171943 2021-03-09 18:04:21.160: INFO @log_variables: train gender_accuracy mean: 0.845993 2021-03-09 18:04:21.161: INFO @log_variables: train gender_confidence/loss nanmean: 0.073867 2021-03-09 18:04:21.161: INFO @log_variables: train gender_confidence/accuracy mean: 0.745732 2021-03-09 18:04:21.161: INFO @log_variables: train age_confidence/loss mean: 0.054148 2021-03-09 18:04:21.161: INFO @log_variables: train age_confidence/accuracy mean: 0.692130 2021-03-09 18:04:21.161: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:04:21.163: INFO @metrics_hook: train age_mae: 10.172 +-0.166 (13824) 2021-03-09 18:04:21.165: INFO @metrics_hook: train gender_accuracy: 0.846 +-0.006 (13824) 2021-03-09 18:04:23.537: INFO @decay_lr : LR updated to `0.000171982` 2021-03-09 18:04:23.538: INFO @log_profile : T train: 18.399174 2021-03-09 18:04:23.538: INFO @log_profile : T read data: 0.388304 2021-03-09 18:04:23.538: INFO @log_profile : T hooks: 2.851665 2021-03-09 18:04:23.538: INFO @main_loop : Epoch 111 done 2021-03-09 18:04:23.538: INFO @main_loop : Training epoch 112 2021-03-09 18:04:43.082: INFO @log_variables: train loss nanmean: 1.437865 2021-03-09 18:04:43.082: INFO @log_variables: train age_loss mean: 10.896000 2021-03-09 18:04:43.082: INFO @log_variables: train gender_loss mean: 0.353879 2021-03-09 18:04:43.082: INFO @log_variables: train age_mae mean: 10.267987 2021-03-09 18:04:43.082: INFO @log_variables: train gender_accuracy mean: 0.840639 2021-03-09 18:04:43.082: INFO @log_variables: train gender_confidence/loss nanmean: 0.072385 2021-03-09 18:04:43.082: INFO @log_variables: train gender_confidence/accuracy mean: 0.749060 2021-03-09 18:04:43.082: INFO @log_variables: train age_confidence/loss mean: 0.053226 2021-03-09 18:04:43.082: INFO @log_variables: train age_confidence/accuracy mean: 0.700882 2021-03-09 18:04:43.082: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:04:43.084: INFO @metrics_hook: train age_mae: 10.268 +-0.165 (13824) 2021-03-09 18:04:43.086: INFO @metrics_hook: train gender_accuracy: 0.841 +-0.006 (13824) 2021-03-09 18:04:47.443: INFO @decay_lr : LR updated to `0.00017112208` 2021-03-09 18:04:47.444: INFO @log_profile : T train: 18.525941 2021-03-09 18:04:47.444: INFO @log_profile : T read data: 0.489494 2021-03-09 18:04:47.444: INFO @log_profile : T hooks: 4.835860 2021-03-09 18:04:47.444: INFO @main_loop : Epoch 112 done 2021-03-09 18:04:47.444: INFO @main_loop : Training epoch 113 2021-03-09 18:05:06.776: INFO @log_variables: train loss nanmean: 1.432405 2021-03-09 18:05:06.777: INFO @log_variables: train age_loss mean: 10.820977 2021-03-09 18:05:06.777: INFO @log_variables: train gender_loss mean: 0.354723 2021-03-09 18:05:06.777: INFO @log_variables: train age_mae mean: 10.197412 2021-03-09 18:05:06.777: INFO @log_variables: train gender_accuracy mean: 0.840712 2021-03-09 18:05:06.777: INFO @log_variables: train gender_confidence/loss nanmean: 0.072366 2021-03-09 18:05:06.778: INFO @log_variables: train gender_confidence/accuracy mean: 0.747541 2021-03-09 18:05:06.778: INFO @log_variables: train age_confidence/loss mean: 0.053838 2021-03-09 18:05:06.778: INFO @log_variables: train age_confidence/accuracy mean: 0.694010 2021-03-09 18:05:06.778: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:05:06.779: INFO @metrics_hook: train age_mae: 10.197 +-0.165 (13824) 2021-03-09 18:05:06.781: INFO @metrics_hook: train gender_accuracy: 0.841 +-0.006 (13824) 2021-03-09 18:05:09.120: INFO @decay_lr : LR updated to `0.00017026647` 2021-03-09 18:05:09.121: INFO @log_profile : T train: 18.447664 2021-03-09 18:05:09.121: INFO @log_profile : T read data: 0.352091 2021-03-09 18:05:09.121: INFO @log_profile : T hooks: 2.824800 2021-03-09 18:05:09.121: INFO @main_loop : Epoch 113 done 2021-03-09 18:05:09.122: INFO @main_loop : Training epoch 114 2021-03-09 18:05:28.304: INFO @log_variables: train loss nanmean: 1.428843 2021-03-09 18:05:28.305: INFO @log_variables: train age_loss mean: 10.859590 2021-03-09 18:05:28.305: INFO @log_variables: train gender_loss mean: 0.345890 2021-03-09 18:05:28.305: INFO @log_variables: train age_mae mean: 10.233318 2021-03-09 18:05:28.305: INFO @log_variables: train gender_accuracy mean: 0.849754 2021-03-09 18:05:28.305: INFO @log_variables: train gender_confidence/loss nanmean: 0.073010 2021-03-09 18:05:28.306: INFO @log_variables: train gender_confidence/accuracy mean: 0.749349 2021-03-09 18:05:28.306: INFO @log_variables: train age_confidence/loss mean: 0.054153 2021-03-09 18:05:28.306: INFO @log_variables: train age_confidence/accuracy mean: 0.689815 2021-03-09 18:05:28.306: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:05:28.308: INFO @metrics_hook: train age_mae: 10.233 +-0.165 (13824) 2021-03-09 18:05:28.310: INFO @metrics_hook: train gender_accuracy: 0.850 +-0.006 (13824) 2021-03-09 18:05:30.557: INFO @decay_lr : LR updated to `0.00016941514` 2021-03-09 18:05:30.559: INFO @log_profile : T train: 18.288642 2021-03-09 18:05:30.559: INFO @log_profile : T read data: 0.347674 2021-03-09 18:05:30.559: INFO @log_profile : T hooks: 2.749872 2021-03-09 18:05:30.559: INFO @main_loop : Epoch 114 done 2021-03-09 18:05:30.559: INFO @main_loop : Training epoch 115 2021-03-09 18:05:49.916: INFO @log_variables: train loss nanmean: 1.416562 2021-03-09 18:05:49.916: INFO @log_variables: train age_loss mean: 10.702503 2021-03-09 18:05:49.916: INFO @log_variables: train gender_loss mean: 0.347417 2021-03-09 18:05:49.917: INFO @log_variables: train age_mae mean: 10.079423 2021-03-09 18:05:49.917: INFO @log_variables: train gender_accuracy mean: 0.845558 2021-03-09 18:05:49.917: INFO @log_variables: train gender_confidence/loss nanmean: 0.073356 2021-03-09 18:05:49.917: INFO @log_variables: train gender_confidence/accuracy mean: 0.763238 2021-03-09 18:05:49.917: INFO @log_variables: train age_confidence/loss mean: 0.054417 2021-03-09 18:05:49.917: INFO @log_variables: train age_confidence/accuracy mean: 0.688730 2021-03-09 18:05:49.917: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:05:49.918: INFO @metrics_hook: train age_mae: 10.079 +-0.163 (13824) 2021-03-09 18:05:49.920: INFO @metrics_hook: train gender_accuracy: 0.846 +-0.006 (13824) 2021-03-09 18:05:52.344: INFO @decay_lr : LR updated to `0.00016856806` 2021-03-09 18:05:52.345: INFO @log_profile : T train: 18.473725 2021-03-09 18:05:52.345: INFO @log_profile : T read data: 0.350924 2021-03-09 18:05:52.345: INFO @log_profile : T hooks: 2.907521 2021-03-09 18:05:52.345: INFO @main_loop : Epoch 115 done 2021-03-09 18:05:52.346: INFO @main_loop : Training epoch 116 2021-03-09 18:06:12.076: INFO @log_variables: train loss nanmean: 1.419866 2021-03-09 18:06:12.076: INFO @log_variables: train age_loss mean: 10.742755 2021-03-09 18:06:12.076: INFO @log_variables: train gender_loss mean: 0.348029 2021-03-09 18:06:12.076: INFO @log_variables: train age_mae mean: 10.123330 2021-03-09 18:06:12.076: INFO @log_variables: train gender_accuracy mean: 0.849609 2021-03-09 18:06:12.076: INFO @log_variables: train gender_confidence/loss nanmean: 0.072838 2021-03-09 18:06:12.076: INFO @log_variables: train gender_confidence/accuracy mean: 0.754123 2021-03-09 18:06:12.076: INFO @log_variables: train age_confidence/loss mean: 0.054024 2021-03-09 18:06:12.077: INFO @log_variables: train age_confidence/accuracy mean: 0.691623 2021-03-09 18:06:12.077: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:06:12.078: INFO @metrics_hook: train age_mae: 10.123 +-0.166 (13824) 2021-03-09 18:06:12.080: INFO @metrics_hook: train gender_accuracy: 0.850 +-0.006 (13824) 2021-03-09 18:06:14.506: INFO @decay_lr : LR updated to `0.00016772521` 2021-03-09 18:06:14.508: INFO @log_profile : T train: 18.698065 2021-03-09 18:06:14.508: INFO @log_profile : T read data: 0.503650 2021-03-09 18:06:14.508: INFO @log_profile : T hooks: 2.907726 2021-03-09 18:06:14.508: INFO @main_loop : Epoch 116 done 2021-03-09 18:06:14.508: INFO @main_loop : Training epoch 117 2021-03-09 18:06:34.321: INFO @log_variables: train loss nanmean: 1.411358 2021-03-09 18:06:34.322: INFO @log_variables: train age_loss mean: 10.594543 2021-03-09 18:06:34.322: INFO @log_variables: train gender_loss mean: 0.353683 2021-03-09 18:06:34.322: INFO @log_variables: train age_mae mean: 9.977635 2021-03-09 18:06:34.322: INFO @log_variables: train gender_accuracy mean: 0.843015 2021-03-09 18:06:34.322: INFO @log_variables: train gender_confidence/loss nanmean: 0.071984 2021-03-09 18:06:34.322: INFO @log_variables: train gender_confidence/accuracy mean: 0.750561 2021-03-09 18:06:34.322: INFO @log_variables: train age_confidence/loss mean: 0.054703 2021-03-09 18:06:34.322: INFO @log_variables: train age_confidence/accuracy mean: 0.690950 2021-03-09 18:06:34.322: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:06:34.324: INFO @metrics_hook: train age_mae: 9.978 +-0.163 (13823) 2021-03-09 18:06:34.326: INFO @metrics_hook: train gender_accuracy: 0.843 +-0.006 (13823) 2021-03-09 18:06:36.668: INFO @decay_lr : LR updated to `0.00016688659` 2021-03-09 18:06:36.670: INFO @log_profile : T train: 18.864843 2021-03-09 18:06:36.670: INFO @log_profile : T read data: 0.381574 2021-03-09 18:06:36.670: INFO @log_profile : T hooks: 2.862663 2021-03-09 18:06:36.670: INFO @main_loop : Epoch 117 done 2021-03-09 18:06:36.670: INFO @main_loop : Training epoch 118 2021-03-09 18:06:56.068: INFO @log_variables: train loss nanmean: 1.435008 2021-03-09 18:06:56.069: INFO @log_variables: train age_loss mean: 10.862161 2021-03-09 18:06:56.069: INFO @log_variables: train gender_loss mean: 0.353301 2021-03-09 18:06:56.069: INFO @log_variables: train age_mae mean: 10.240479 2021-03-09 18:06:56.069: INFO @log_variables: train gender_accuracy mean: 0.840495 2021-03-09 18:06:56.069: INFO @log_variables: train gender_confidence/loss nanmean: 0.072581 2021-03-09 18:06:56.069: INFO @log_variables: train gender_confidence/accuracy mean: 0.747541 2021-03-09 18:06:56.069: INFO @log_variables: train age_confidence/loss mean: 0.053775 2021-03-09 18:06:56.069: INFO @log_variables: train age_confidence/accuracy mean: 0.692636 2021-03-09 18:06:56.069: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:06:56.071: INFO @metrics_hook: train age_mae: 10.240 +-0.166 (13824) 2021-03-09 18:06:56.074: INFO @metrics_hook: train gender_accuracy: 0.840 +-0.006 (13824) 2021-03-09 18:06:58.688: INFO @decay_lr : LR updated to `0.00016605215` 2021-03-09 18:06:58.692: INFO @log_profile : T train: 18.518454 2021-03-09 18:06:58.693: INFO @log_profile : T read data: 0.361322 2021-03-09 18:06:58.694: INFO @log_profile : T hooks: 3.089636 2021-03-09 18:06:58.696: INFO @main_loop : Epoch 118 done 2021-03-09 18:06:58.696: INFO @main_loop : Training epoch 119 2021-03-09 18:07:21.180: INFO @log_variables: train loss nanmean: 1.406884 2021-03-09 18:07:21.181: INFO @log_variables: train age_loss mean: 10.752934 2021-03-09 18:07:21.181: INFO @log_variables: train gender_loss mean: 0.334285 2021-03-09 18:07:21.181: INFO @log_variables: train age_mae mean: 10.133779 2021-03-09 18:07:21.181: INFO @log_variables: train gender_accuracy mean: 0.854601 2021-03-09 18:07:21.181: INFO @log_variables: train gender_confidence/loss nanmean: 0.072161 2021-03-09 18:07:21.181: INFO @log_variables: train gender_confidence/accuracy mean: 0.762370 2021-03-09 18:07:21.181: INFO @log_variables: train age_confidence/loss mean: 0.053288 2021-03-09 18:07:21.181: INFO @log_variables: train age_confidence/accuracy mean: 0.698712 2021-03-09 18:07:21.181: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:07:21.183: INFO @metrics_hook: train age_mae: 10.134 +-0.162 (13824) 2021-03-09 18:07:21.185: INFO @metrics_hook: train gender_accuracy: 0.855 +-0.006 (13824) 2021-03-09 18:07:24.119: INFO @decay_lr : LR updated to `0.00016522189` 2021-03-09 18:07:24.123: INFO @log_profile : T train: 21.236075 2021-03-09 18:07:24.124: INFO @log_profile : T read data: 0.702393 2021-03-09 18:07:24.125: INFO @log_profile : T hooks: 3.430841 2021-03-09 18:07:24.126: INFO @main_loop : Epoch 119 done 2021-03-09 18:07:24.127: INFO @main_loop : Training epoch 120 2021-03-09 18:07:46.491: INFO @log_variables: train loss nanmean: 1.400936 2021-03-09 18:07:46.491: INFO @log_variables: train age_loss mean: 10.617964 2021-03-09 18:07:46.491: INFO @log_variables: train gender_loss mean: 0.339199 2021-03-09 18:07:46.491: INFO @log_variables: train age_mae mean: 10.000166 2021-03-09 18:07:46.492: INFO @log_variables: train gender_accuracy mean: 0.852792 2021-03-09 18:07:46.492: INFO @log_variables: train gender_confidence/loss nanmean: 0.073114 2021-03-09 18:07:46.492: INFO @log_variables: train gender_confidence/accuracy mean: 0.752532 2021-03-09 18:07:46.492: INFO @log_variables: train age_confidence/loss mean: 0.054190 2021-03-09 18:07:46.492: INFO @log_variables: train age_confidence/accuracy mean: 0.690321 2021-03-09 18:07:46.492: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:07:46.494: INFO @metrics_hook: train age_mae: 10.000 +-0.160 (13824) 2021-03-09 18:07:46.496: INFO @metrics_hook: train gender_accuracy: 0.853 +-0.006 (13824) 2021-03-09 18:07:49.683: INFO @decay_lr : LR updated to `0.00016439578` 2021-03-09 18:07:49.685: INFO @log_profile : T train: 21.281018 2021-03-09 18:07:49.685: INFO @log_profile : T read data: 0.536376 2021-03-09 18:07:49.685: INFO @log_profile : T hooks: 3.684895 2021-03-09 18:07:49.686: INFO @main_loop : Epoch 120 done 2021-03-09 18:07:49.686: INFO @main_loop : Training epoch 121 2021-03-09 18:08:10.371: INFO @log_variables: train loss nanmean: 1.406475 2021-03-09 18:08:10.371: INFO @log_variables: train age_loss mean: 10.679287 2021-03-09 18:08:10.371: INFO @log_variables: train gender_loss mean: 0.339472 2021-03-09 18:08:10.371: INFO @log_variables: train age_mae mean: 10.060352 2021-03-09 18:08:10.371: INFO @log_variables: train gender_accuracy mean: 0.852503 2021-03-09 18:08:10.371: INFO @log_variables: train gender_confidence/loss nanmean: 0.072597 2021-03-09 18:08:10.371: INFO @log_variables: train gender_confidence/accuracy mean: 0.755787 2021-03-09 18:08:10.371: INFO @log_variables: train age_confidence/loss mean: 0.054422 2021-03-09 18:08:10.372: INFO @log_variables: train age_confidence/accuracy mean: 0.690104 2021-03-09 18:08:10.372: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:08:10.374: INFO @metrics_hook: train age_mae: 10.060 +-0.164 (13824) 2021-03-09 18:08:10.376: INFO @metrics_hook: train gender_accuracy: 0.853 +-0.006 (13824) 2021-03-09 18:08:12.620: INFO @decay_lr : LR updated to `0.0001635738` 2021-03-09 18:08:12.622: INFO @log_profile : T train: 19.683805 2021-03-09 18:08:12.622: INFO @log_profile : T read data: 0.421901 2021-03-09 18:08:12.622: INFO @log_profile : T hooks: 2.776482 2021-03-09 18:08:12.622: INFO @main_loop : Epoch 121 done 2021-03-09 18:08:12.622: INFO @main_loop : Training epoch 122 2021-03-09 18:08:32.483: INFO @log_variables: train loss nanmean: 1.391070 2021-03-09 18:08:32.483: INFO @log_variables: train age_loss mean: 10.461187 2021-03-09 18:08:32.483: INFO @log_variables: train gender_loss mean: 0.344726 2021-03-09 18:08:32.483: INFO @log_variables: train age_mae mean: 9.846851 2021-03-09 18:08:32.483: INFO @log_variables: train gender_accuracy mean: 0.844112 2021-03-09 18:08:32.483: INFO @log_variables: train gender_confidence/loss nanmean: 0.071456 2021-03-09 18:08:32.483: INFO @log_variables: train gender_confidence/accuracy mean: 0.755064 2021-03-09 18:08:32.483: INFO @log_variables: train age_confidence/loss mean: 0.055209 2021-03-09 18:08:32.484: INFO @log_variables: train age_confidence/accuracy mean: 0.683521 2021-03-09 18:08:32.484: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:08:32.486: INFO @metrics_hook: train age_mae: 9.847 +-0.160 (13824) 2021-03-09 18:08:32.488: INFO @metrics_hook: train gender_accuracy: 0.844 +-0.006 (13824) 2021-03-09 18:08:34.510: INFO @decay_lr : LR updated to `0.00016275592` 2021-03-09 18:08:34.511: INFO @log_profile : T train: 18.812448 2021-03-09 18:08:34.511: INFO @log_profile : T read data: 0.498472 2021-03-09 18:08:34.511: INFO @log_profile : T hooks: 2.525470 2021-03-09 18:08:34.511: INFO @main_loop : Epoch 122 done 2021-03-09 18:08:34.511: INFO @main_loop : Training epoch 123 2021-03-09 18:08:53.666: INFO @log_variables: train loss nanmean: 1.412183 2021-03-09 18:08:53.666: INFO @log_variables: train age_loss mean: 10.713960 2021-03-09 18:08:53.666: INFO @log_variables: train gender_loss mean: 0.342420 2021-03-09 18:08:53.666: INFO @log_variables: train age_mae mean: 10.094349 2021-03-09 18:08:53.666: INFO @log_variables: train gender_accuracy mean: 0.847729 2021-03-09 18:08:53.666: INFO @log_variables: train gender_confidence/loss nanmean: 0.072599 2021-03-09 18:08:53.666: INFO @log_variables: train gender_confidence/accuracy mean: 0.755425 2021-03-09 18:08:53.667: INFO @log_variables: train age_confidence/loss mean: 0.054297 2021-03-09 18:08:53.667: INFO @log_variables: train age_confidence/accuracy mean: 0.689670 2021-03-09 18:08:53.667: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:08:53.669: INFO @metrics_hook: train age_mae: 10.094 +-0.165 (13824) 2021-03-09 18:08:53.671: INFO @metrics_hook: train gender_accuracy: 0.848 +-0.006 (13824) 2021-03-09 18:08:55.980: INFO @decay_lr : LR updated to `0.00016194214` 2021-03-09 18:08:55.981: INFO @log_profile : T train: 18.279987 2021-03-09 18:08:55.982: INFO @log_profile : T read data: 0.325028 2021-03-09 18:08:55.982: INFO @log_profile : T hooks: 2.815555 2021-03-09 18:08:55.982: INFO @main_loop : Epoch 123 done 2021-03-09 18:08:55.982: INFO @main_loop : Training epoch 124 2021-03-09 18:09:15.498: INFO @log_variables: train loss nanmean: 1.374543 2021-03-09 18:09:15.498: INFO @log_variables: train age_loss mean: 10.400946 2021-03-09 18:09:15.499: INFO @log_variables: train gender_loss mean: 0.332247 2021-03-09 18:09:15.499: INFO @log_variables: train age_mae mean: 9.788307 2021-03-09 18:09:15.499: INFO @log_variables: train gender_accuracy mean: 0.853877 2021-03-09 18:09:15.499: INFO @log_variables: train gender_confidence/loss nanmean: 0.072396 2021-03-09 18:09:15.499: INFO @log_variables: train gender_confidence/accuracy mean: 0.759259 2021-03-09 18:09:15.499: INFO @log_variables: train age_confidence/loss mean: 0.054564 2021-03-09 18:09:15.499: INFO @log_variables: train age_confidence/accuracy mean: 0.688947 2021-03-09 18:09:15.499: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:09:15.501: INFO @metrics_hook: train age_mae: 9.788 +-0.161 (13824) 2021-03-09 18:09:15.503: INFO @metrics_hook: train gender_accuracy: 0.854 +-0.006 (13824) 2021-03-09 18:09:17.716: INFO @decay_lr : LR updated to `0.00016113243` 2021-03-09 18:09:17.718: INFO @log_profile : T train: 18.631605 2021-03-09 18:09:17.718: INFO @log_profile : T read data: 0.338898 2021-03-09 18:09:17.718: INFO @log_profile : T hooks: 2.713014 2021-03-09 18:09:17.718: INFO @main_loop : Epoch 124 done 2021-03-09 18:09:17.718: INFO @main_loop : Training epoch 125 2021-03-09 18:09:37.223: INFO @log_variables: train loss nanmean: 1.392190 2021-03-09 18:09:37.223: INFO @log_variables: train age_loss mean: 10.497890 2021-03-09 18:09:37.223: INFO @log_variables: train gender_loss mean: 0.341177 2021-03-09 18:09:37.224: INFO @log_variables: train age_mae mean: 9.884626 2021-03-09 18:09:37.224: INFO @log_variables: train gender_accuracy mean: 0.849816 2021-03-09 18:09:37.224: INFO @log_variables: train gender_confidence/loss nanmean: 0.073047 2021-03-09 18:09:37.224: INFO @log_variables: train gender_confidence/accuracy mean: 0.754033 2021-03-09 18:09:37.224: INFO @log_variables: train age_confidence/loss mean: 0.054629 2021-03-09 18:09:37.224: INFO @log_variables: train age_confidence/accuracy mean: 0.685452 2021-03-09 18:09:37.224: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:09:37.226: INFO @metrics_hook: train age_mae: 9.885 +-0.160 (13823) 2021-03-09 18:09:37.228: INFO @metrics_hook: train gender_accuracy: 0.850 +-0.006 (13823) 2021-03-09 18:09:39.555: INFO @decay_lr : LR updated to `0.00016032676` 2021-03-09 18:09:39.556: INFO @log_profile : T train: 18.509174 2021-03-09 18:09:39.556: INFO @log_profile : T read data: 0.446215 2021-03-09 18:09:39.556: INFO @log_profile : T hooks: 2.829680 2021-03-09 18:09:39.556: INFO @main_loop : Epoch 125 done 2021-03-09 18:09:39.556: INFO @main_loop : Training epoch 126 2021-03-09 18:09:58.914: INFO @log_variables: train loss nanmean: 1.373975 2021-03-09 18:09:58.914: INFO @log_variables: train age_loss mean: 10.348610 2021-03-09 18:09:58.914: INFO @log_variables: train gender_loss mean: 0.335903 2021-03-09 18:09:58.915: INFO @log_variables: train age_mae mean: 9.737714 2021-03-09 18:09:58.915: INFO @log_variables: train gender_accuracy mean: 0.854311 2021-03-09 18:09:58.915: INFO @log_variables: train gender_confidence/loss nanmean: 0.073008 2021-03-09 18:09:58.915: INFO @log_variables: train gender_confidence/accuracy mean: 0.756727 2021-03-09 18:09:58.915: INFO @log_variables: train age_confidence/loss mean: 0.054819 2021-03-09 18:09:58.915: INFO @log_variables: train age_confidence/accuracy mean: 0.688513 2021-03-09 18:09:58.915: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:09:58.916: INFO @metrics_hook: train age_mae: 9.738 +-0.160 (13824) 2021-03-09 18:09:58.917: INFO @metrics_hook: train gender_accuracy: 0.854 +-0.006 (13824) 2021-03-09 18:10:01.198: INFO @decay_lr : LR updated to `0.00015952512` 2021-03-09 18:10:01.199: INFO @log_profile : T train: 18.460734 2021-03-09 18:10:01.200: INFO @log_profile : T read data: 0.359081 2021-03-09 18:10:01.200: INFO @log_profile : T hooks: 2.770940 2021-03-09 18:10:01.200: INFO @main_loop : Epoch 126 done 2021-03-09 18:10:01.200: INFO @main_loop : Training epoch 127 2021-03-09 18:10:22.759: INFO @log_variables: train loss nanmean: 1.390261 2021-03-09 18:10:22.761: INFO @log_variables: train age_loss mean: 10.547157 2021-03-09 18:10:22.763: INFO @log_variables: train gender_loss mean: 0.335295 2021-03-09 18:10:22.765: INFO @log_variables: train age_mae mean: 9.937718 2021-03-09 18:10:22.768: INFO @log_variables: train gender_accuracy mean: 0.852565 2021-03-09 18:10:22.770: INFO @log_variables: train gender_confidence/loss nanmean: 0.072473 2021-03-09 18:10:22.771: INFO @log_variables: train gender_confidence/accuracy mean: 0.756420 2021-03-09 18:10:22.773: INFO @log_variables: train age_confidence/loss mean: 0.054141 2021-03-09 18:10:22.774: INFO @log_variables: train age_confidence/accuracy mean: 0.691456 2021-03-09 18:10:22.778: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:10:22.779: INFO @metrics_hook: train age_mae: 9.938 +-0.161 (13823) 2021-03-09 18:10:22.781: INFO @metrics_hook: train gender_accuracy: 0.853 +-0.006 (13823) 2021-03-09 18:10:25.747: INFO @decay_lr : LR updated to `0.0001587275` 2021-03-09 18:10:25.749: INFO @log_profile : T train: 20.380016 2021-03-09 18:10:25.749: INFO @log_profile : T read data: 0.502285 2021-03-09 18:10:25.749: INFO @log_profile : T hooks: 3.608023 2021-03-09 18:10:25.750: INFO @main_loop : Epoch 127 done 2021-03-09 18:10:25.750: INFO @main_loop : Training epoch 128 2021-03-09 18:10:47.326: INFO @log_variables: train loss nanmean: 1.406411 2021-03-09 18:10:47.326: INFO @log_variables: train age_loss mean: 10.705192 2021-03-09 18:10:47.326: INFO @log_variables: train gender_loss mean: 0.337106 2021-03-09 18:10:47.326: INFO @log_variables: train age_mae mean: 10.089713 2021-03-09 18:10:47.326: INFO @log_variables: train gender_accuracy mean: 0.851997 2021-03-09 18:10:47.326: INFO @log_variables: train gender_confidence/loss nanmean: 0.072578 2021-03-09 18:10:47.327: INFO @log_variables: train gender_confidence/accuracy mean: 0.754485 2021-03-09 18:10:47.327: INFO @log_variables: train age_confidence/loss mean: 0.054175 2021-03-09 18:10:47.327: INFO @log_variables: train age_confidence/accuracy mean: 0.694155 2021-03-09 18:10:47.327: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:10:47.329: INFO @metrics_hook: train age_mae: 10.090 +-0.164 (13824) 2021-03-09 18:10:47.331: INFO @metrics_hook: train gender_accuracy: 0.852 +-0.006 (13824) 2021-03-09 18:10:50.224: INFO @decay_lr : LR updated to `0.00015793387` 2021-03-09 18:10:50.226: INFO @log_profile : T train: 20.230433 2021-03-09 18:10:50.226: INFO @log_profile : T read data: 0.706568 2021-03-09 18:10:50.226: INFO @log_profile : T hooks: 3.472694 2021-03-09 18:10:50.226: INFO @main_loop : Epoch 128 done 2021-03-09 18:10:50.226: INFO @main_loop : Training epoch 129 2021-03-09 18:11:11.335: INFO @log_variables: train loss nanmean: 1.391006 2021-03-09 18:11:11.336: INFO @log_variables: train age_loss mean: 10.593133 2021-03-09 18:11:11.336: INFO @log_variables: train gender_loss mean: 0.331769 2021-03-09 18:11:11.336: INFO @log_variables: train age_mae mean: 9.980174 2021-03-09 18:11:11.336: INFO @log_variables: train gender_accuracy mean: 0.852792 2021-03-09 18:11:11.336: INFO @log_variables: train gender_confidence/loss nanmean: 0.072284 2021-03-09 18:11:11.336: INFO @log_variables: train gender_confidence/accuracy mean: 0.762876 2021-03-09 18:11:11.336: INFO @log_variables: train age_confidence/loss mean: 0.054102 2021-03-09 18:11:11.336: INFO @log_variables: train age_confidence/accuracy mean: 0.689236 2021-03-09 18:11:11.336: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:11:11.338: INFO @metrics_hook: train age_mae: 9.980 +-0.162 (13824) 2021-03-09 18:11:11.340: INFO @metrics_hook: train gender_accuracy: 0.853 +-0.006 (13824) 2021-03-09 18:11:14.221: INFO @decay_lr : LR updated to `0.0001571442` 2021-03-09 18:11:14.223: INFO @log_profile : T train: 20.085092 2021-03-09 18:11:14.223: INFO @log_profile : T read data: 0.459500 2021-03-09 18:11:14.223: INFO @log_profile : T hooks: 3.394107 2021-03-09 18:11:14.223: INFO @main_loop : Epoch 129 done 2021-03-09 18:11:14.223: INFO @main_loop : Training epoch 130 2021-03-09 18:11:35.864: INFO @log_variables: train loss nanmean: 1.382772 2021-03-09 18:11:35.865: INFO @log_variables: train age_loss mean: 10.513517 2021-03-09 18:11:35.865: INFO @log_variables: train gender_loss mean: 0.330962 2021-03-09 18:11:35.865: INFO @log_variables: train age_mae mean: 9.902651 2021-03-09 18:11:35.865: INFO @log_variables: train gender_accuracy mean: 0.853443 2021-03-09 18:11:35.865: INFO @log_variables: train gender_confidence/loss nanmean: 0.071910 2021-03-09 18:11:35.865: INFO @log_variables: train gender_confidence/accuracy mean: 0.756727 2021-03-09 18:11:35.865: INFO @log_variables: train age_confidence/loss mean: 0.054213 2021-03-09 18:11:35.865: INFO @log_variables: train age_confidence/accuracy mean: 0.694083 2021-03-09 18:11:35.865: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:11:35.867: INFO @metrics_hook: train age_mae: 9.903 +-0.161 (13824) 2021-03-09 18:11:35.869: INFO @metrics_hook: train gender_accuracy: 0.853 +-0.006 (13824) 2021-03-09 18:11:38.633: INFO @decay_lr : LR updated to `0.00015635848` 2021-03-09 18:11:38.635: INFO @log_profile : T train: 20.477378 2021-03-09 18:11:38.635: INFO @log_profile : T read data: 0.577604 2021-03-09 18:11:38.635: INFO @log_profile : T hooks: 3.299385 2021-03-09 18:11:38.635: INFO @main_loop : Epoch 130 done 2021-03-09 18:11:38.635: INFO @main_loop : Training epoch 131 2021-03-09 18:11:58.747: INFO @log_variables: train loss nanmean: 1.377778 2021-03-09 18:11:58.748: INFO @log_variables: train age_loss mean: 10.477727 2021-03-09 18:11:58.748: INFO @log_variables: train gender_loss mean: 0.328314 2021-03-09 18:11:58.748: INFO @log_variables: train age_mae mean: 9.867161 2021-03-09 18:11:58.748: INFO @log_variables: train gender_accuracy mean: 0.859447 2021-03-09 18:11:58.748: INFO @log_variables: train gender_confidence/loss nanmean: 0.071894 2021-03-09 18:11:58.748: INFO @log_variables: train gender_confidence/accuracy mean: 0.757089 2021-03-09 18:11:58.748: INFO @log_variables: train age_confidence/loss mean: 0.054896 2021-03-09 18:11:58.748: INFO @log_variables: train age_confidence/accuracy mean: 0.688657 2021-03-09 18:11:58.748: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:11:58.750: INFO @metrics_hook: train age_mae: 9.867 +-0.161 (13824) 2021-03-09 18:11:58.752: INFO @metrics_hook: train gender_accuracy: 0.859 +-0.006 (13824) 2021-03-09 18:12:00.978: INFO @decay_lr : LR updated to `0.0001555767` 2021-03-09 18:12:00.979: INFO @log_profile : T train: 19.103796 2021-03-09 18:12:00.979: INFO @log_profile : T read data: 0.357969 2021-03-09 18:12:00.980: INFO @log_profile : T hooks: 2.826689 2021-03-09 18:12:00.980: INFO @main_loop : Epoch 131 done 2021-03-09 18:12:00.980: INFO @main_loop : Training epoch 132 2021-03-09 18:12:20.413: INFO @log_variables: train loss nanmean: 1.361477 2021-03-09 18:12:20.414: INFO @log_variables: train age_loss mean: 10.258453 2021-03-09 18:12:20.414: INFO @log_variables: train gender_loss mean: 0.332525 2021-03-09 18:12:20.415: INFO @log_variables: train age_mae mean: 9.650658 2021-03-09 18:12:20.415: INFO @log_variables: train gender_accuracy mean: 0.852865 2021-03-09 18:12:20.415: INFO @log_variables: train gender_confidence/loss nanmean: 0.071690 2021-03-09 18:12:20.415: INFO @log_variables: train gender_confidence/accuracy mean: 0.757957 2021-03-09 18:12:20.415: INFO @log_variables: train age_confidence/loss mean: 0.054905 2021-03-09 18:12:20.416: INFO @log_variables: train age_confidence/accuracy mean: 0.684751 2021-03-09 18:12:20.416: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:12:20.423: INFO @metrics_hook: train age_mae: 9.651 +-0.157 (13824) 2021-03-09 18:12:20.428: INFO @metrics_hook: train gender_accuracy: 0.853 +-0.006 (13824) 2021-03-09 18:12:22.705: INFO @decay_lr : LR updated to `0.0001547988` 2021-03-09 18:12:22.706: INFO @log_profile : T train: 18.347266 2021-03-09 18:12:22.706: INFO @log_profile : T read data: 0.490880 2021-03-09 18:12:22.707: INFO @log_profile : T hooks: 2.835826 2021-03-09 18:12:22.707: INFO @main_loop : Epoch 132 done 2021-03-09 18:12:22.707: INFO @main_loop : Training epoch 133 2021-03-09 18:12:42.293: INFO @log_variables: train loss nanmean: 1.374605 2021-03-09 18:12:42.294: INFO @log_variables: train age_loss mean: 10.468655 2021-03-09 18:12:42.294: INFO @log_variables: train gender_loss mean: 0.326904 2021-03-09 18:12:42.294: INFO @log_variables: train age_mae mean: 9.859943 2021-03-09 18:12:42.294: INFO @log_variables: train gender_accuracy mean: 0.856843 2021-03-09 18:12:42.294: INFO @log_variables: train gender_confidence/loss nanmean: 0.071271 2021-03-09 18:12:42.294: INFO @log_variables: train gender_confidence/accuracy mean: 0.757595 2021-03-09 18:12:42.294: INFO @log_variables: train age_confidence/loss mean: 0.054453 2021-03-09 18:12:42.294: INFO @log_variables: train age_confidence/accuracy mean: 0.690611 2021-03-09 18:12:42.294: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:12:42.297: INFO @metrics_hook: train age_mae: 9.860 +-0.161 (13824) 2021-03-09 18:12:42.299: INFO @metrics_hook: train gender_accuracy: 0.857 +-0.006 (13824) 2021-03-09 18:12:44.683: INFO @decay_lr : LR updated to `0.00015402482` 2021-03-09 18:12:44.686: INFO @log_profile : T train: 18.662722 2021-03-09 18:12:44.686: INFO @log_profile : T read data: 0.347444 2021-03-09 18:12:44.686: INFO @log_profile : T hooks: 2.917216 2021-03-09 18:12:44.686: INFO @main_loop : Epoch 133 done 2021-03-09 18:12:44.686: INFO @main_loop : Training epoch 134 2021-03-09 18:13:03.857: INFO @log_variables: train loss nanmean: 1.381223 2021-03-09 18:13:03.858: INFO @log_variables: train age_loss mean: 10.495739 2021-03-09 18:13:03.858: INFO @log_variables: train gender_loss mean: 0.330545 2021-03-09 18:13:03.858: INFO @log_variables: train age_mae mean: 9.883385 2021-03-09 18:13:03.858: INFO @log_variables: train gender_accuracy mean: 0.855179 2021-03-09 18:13:03.858: INFO @log_variables: train gender_confidence/loss nanmean: 0.071423 2021-03-09 18:13:03.858: INFO @log_variables: train gender_confidence/accuracy mean: 0.758319 2021-03-09 18:13:03.858: INFO @log_variables: train age_confidence/loss mean: 0.055146 2021-03-09 18:13:03.858: INFO @log_variables: train age_confidence/accuracy mean: 0.685113 2021-03-09 18:13:03.858: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:13:03.859: INFO @metrics_hook: train age_mae: 9.883 +-0.162 (13824) 2021-03-09 18:13:03.860: INFO @metrics_hook: train gender_accuracy: 0.855 +-0.006 (13824) 2021-03-09 18:13:05.893: INFO @decay_lr : LR updated to `0.00015325469` 2021-03-09 18:13:05.894: INFO @log_profile : T train: 18.285727 2021-03-09 18:13:05.894: INFO @log_profile : T read data: 0.320045 2021-03-09 18:13:05.894: INFO @log_profile : T hooks: 2.550613 2021-03-09 18:13:05.894: INFO @main_loop : Epoch 134 done 2021-03-09 18:13:05.894: INFO @main_loop : Training epoch 135 2021-03-09 18:13:25.156: INFO @log_variables: train loss nanmean: 1.361426 2021-03-09 18:13:25.157: INFO @log_variables: train age_loss mean: 10.236417 2021-03-09 18:13:25.157: INFO @log_variables: train gender_loss mean: 0.333126 2021-03-09 18:13:25.157: INFO @log_variables: train age_mae mean: 9.635234 2021-03-09 18:13:25.157: INFO @log_variables: train gender_accuracy mean: 0.853794 2021-03-09 18:13:25.157: INFO @log_variables: train gender_confidence/loss nanmean: 0.072994 2021-03-09 18:13:25.157: INFO @log_variables: train gender_confidence/accuracy mean: 0.758374 2021-03-09 18:13:25.157: INFO @log_variables: train age_confidence/loss mean: 0.055008 2021-03-09 18:13:25.157: INFO @log_variables: train age_confidence/accuracy mean: 0.685307 2021-03-09 18:13:25.157: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:13:25.159: INFO @metrics_hook: train age_mae: 9.635 +-0.159 (13823) 2021-03-09 18:13:25.161: INFO @metrics_hook: train gender_accuracy: 0.854 +-0.006 (13823) 2021-03-09 18:13:27.527: INFO @decay_lr : LR updated to `0.00015248841` 2021-03-09 18:13:27.529: INFO @log_profile : T train: 18.265304 2021-03-09 18:13:27.529: INFO @log_profile : T read data: 0.457877 2021-03-09 18:13:27.529: INFO @log_profile : T hooks: 2.861849 2021-03-09 18:13:27.529: INFO @main_loop : Epoch 135 done 2021-03-09 18:13:27.529: INFO @main_loop : Training epoch 136 2021-03-09 18:13:47.040: INFO @log_variables: train loss nanmean: 1.359430 2021-03-09 18:13:47.040: INFO @log_variables: train age_loss mean: 10.317241 2021-03-09 18:13:47.040: INFO @log_variables: train gender_loss mean: 0.324241 2021-03-09 18:13:47.041: INFO @log_variables: train age_mae mean: 9.713353 2021-03-09 18:13:47.041: INFO @log_variables: train gender_accuracy mean: 0.859809 2021-03-09 18:13:47.041: INFO @log_variables: train gender_confidence/loss nanmean: 0.072172 2021-03-09 18:13:47.041: INFO @log_variables: train gender_confidence/accuracy mean: 0.759187 2021-03-09 18:13:47.041: INFO @log_variables: train age_confidence/loss mean: 0.054562 2021-03-09 18:13:47.041: INFO @log_variables: train age_confidence/accuracy mean: 0.686560 2021-03-09 18:13:47.041: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:13:47.043: INFO @metrics_hook: train age_mae: 9.713 +-0.158 (13824) 2021-03-09 18:13:47.044: INFO @metrics_hook: train gender_accuracy: 0.860 +-0.006 (13824) 2021-03-09 18:13:49.344: INFO @decay_lr : LR updated to `0.00015172597` 2021-03-09 18:13:49.346: INFO @log_profile : T train: 18.628436 2021-03-09 18:13:49.346: INFO @log_profile : T read data: 0.361917 2021-03-09 18:13:49.346: INFO @log_profile : T hooks: 2.774053 2021-03-09 18:13:49.346: INFO @main_loop : Epoch 136 done 2021-03-09 18:13:49.346: INFO @main_loop : Training epoch 137 2021-03-09 18:14:08.947: INFO @log_variables: train loss nanmean: 1.357741 2021-03-09 18:14:08.947: INFO @log_variables: train age_loss mean: 10.168592 2021-03-09 18:14:08.947: INFO @log_variables: train gender_loss mean: 0.335750 2021-03-09 18:14:08.947: INFO @log_variables: train age_mae mean: 9.564349 2021-03-09 18:14:08.947: INFO @log_variables: train gender_accuracy mean: 0.853443 2021-03-09 18:14:08.947: INFO @log_variables: train gender_confidence/loss nanmean: 0.072472 2021-03-09 18:14:08.947: INFO @log_variables: train gender_confidence/accuracy mean: 0.759476 2021-03-09 18:14:08.947: INFO @log_variables: train age_confidence/loss mean: 0.055624 2021-03-09 18:14:08.947: INFO @log_variables: train age_confidence/accuracy mean: 0.681930 2021-03-09 18:14:08.947: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:14:08.950: INFO @metrics_hook: train age_mae: 9.564 +-0.158 (13824) 2021-03-09 18:14:08.952: INFO @metrics_hook: train gender_accuracy: 0.853 +-0.006 (13824) 2021-03-09 18:14:11.380: INFO @decay_lr : LR updated to `0.00015096733` 2021-03-09 18:14:11.382: INFO @log_profile : T train: 18.684247 2021-03-09 18:14:11.382: INFO @log_profile : T read data: 0.386681 2021-03-09 18:14:11.382: INFO @log_profile : T hooks: 2.912368 2021-03-09 18:14:11.382: INFO @main_loop : Epoch 137 done 2021-03-09 18:14:11.382: INFO @main_loop : Training epoch 138 2021-03-09 18:14:31.040: INFO @log_variables: train loss nanmean: 1.376068 2021-03-09 18:14:31.041: INFO @log_variables: train age_loss mean: 10.435156 2021-03-09 18:14:31.041: INFO @log_variables: train gender_loss mean: 0.330472 2021-03-09 18:14:31.041: INFO @log_variables: train age_mae mean: 9.828138 2021-03-09 18:14:31.041: INFO @log_variables: train gender_accuracy mean: 0.855469 2021-03-09 18:14:31.041: INFO @log_variables: train gender_confidence/loss nanmean: 0.072751 2021-03-09 18:14:31.041: INFO @log_variables: train gender_confidence/accuracy mean: 0.756293 2021-03-09 18:14:31.041: INFO @log_variables: train age_confidence/loss mean: 0.054237 2021-03-09 18:14:31.041: INFO @log_variables: train age_confidence/accuracy mean: 0.692419 2021-03-09 18:14:31.041: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:14:31.043: INFO @metrics_hook: train age_mae: 9.828 +-0.163 (13824) 2021-03-09 18:14:31.045: INFO @metrics_hook: train gender_accuracy: 0.855 +-0.006 (13824) 2021-03-09 18:14:33.206: INFO @decay_lr : LR updated to `0.0001502125` 2021-03-09 18:14:33.207: INFO @log_profile : T train: 18.631507 2021-03-09 18:14:33.207: INFO @log_profile : T read data: 0.501994 2021-03-09 18:14:33.207: INFO @log_profile : T hooks: 2.639734 2021-03-09 18:14:33.207: INFO @main_loop : Epoch 138 done 2021-03-09 18:14:33.207: INFO @main_loop : Training epoch 139 2021-03-09 18:14:52.351: INFO @log_variables: train loss nanmean: 1.377828 2021-03-09 18:14:52.351: INFO @log_variables: train age_loss mean: 10.371840 2021-03-09 18:14:52.351: INFO @log_variables: train gender_loss mean: 0.337713 2021-03-09 18:14:52.351: INFO @log_variables: train age_mae mean: 9.763270 2021-03-09 18:14:52.352: INFO @log_variables: train gender_accuracy mean: 0.853371 2021-03-09 18:14:52.352: INFO @log_variables: train gender_confidence/loss nanmean: 0.073006 2021-03-09 18:14:52.352: INFO @log_variables: train gender_confidence/accuracy mean: 0.753979 2021-03-09 18:14:52.352: INFO @log_variables: train age_confidence/loss mean: 0.054915 2021-03-09 18:14:52.352: INFO @log_variables: train age_confidence/accuracy mean: 0.685475 2021-03-09 18:14:52.352: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:14:52.354: INFO @metrics_hook: train age_mae: 9.763 +-0.159 (13824) 2021-03-09 18:14:52.356: INFO @metrics_hook: train gender_accuracy: 0.853 +-0.006 (13824) 2021-03-09 18:14:54.445: INFO @decay_lr : LR updated to `0.00014946143` 2021-03-09 18:14:54.446: INFO @log_profile : T train: 18.216582 2021-03-09 18:14:54.446: INFO @log_profile : T read data: 0.340518 2021-03-09 18:14:54.446: INFO @log_profile : T hooks: 2.623419 2021-03-09 18:14:54.446: INFO @main_loop : Epoch 139 done 2021-03-09 18:14:54.446: INFO @main_loop : Training epoch 140 2021-03-09 18:15:13.868: INFO @log_variables: train loss nanmean: 1.372473 2021-03-09 18:15:13.868: INFO @log_variables: train age_loss mean: 10.394448 2021-03-09 18:15:13.868: INFO @log_variables: train gender_loss mean: 0.330301 2021-03-09 18:15:13.868: INFO @log_variables: train age_mae mean: 9.786056 2021-03-09 18:15:13.868: INFO @log_variables: train gender_accuracy mean: 0.854673 2021-03-09 18:15:13.868: INFO @log_variables: train gender_confidence/loss nanmean: 0.072333 2021-03-09 18:15:13.869: INFO @log_variables: train gender_confidence/accuracy mean: 0.758898 2021-03-09 18:15:13.869: INFO @log_variables: train age_confidence/loss mean: 0.054916 2021-03-09 18:15:13.869: INFO @log_variables: train age_confidence/accuracy mean: 0.686849 2021-03-09 18:15:13.869: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:15:13.870: INFO @metrics_hook: train age_mae: 9.786 +-0.161 (13824) 2021-03-09 18:15:13.871: INFO @metrics_hook: train gender_accuracy: 0.855 +-0.006 (13824) 2021-03-09 18:15:16.209: INFO @decay_lr : LR updated to `0.00014871411` 2021-03-09 18:15:16.210: INFO @log_profile : T train: 18.523935 2021-03-09 18:15:16.210: INFO @log_profile : T read data: 0.373324 2021-03-09 18:15:16.210: INFO @log_profile : T hooks: 2.813337 2021-03-09 18:15:16.210: INFO @main_loop : Epoch 140 done 2021-03-09 18:15:16.210: INFO @main_loop : Training epoch 141 2021-03-09 18:15:35.705: INFO @log_variables: train loss nanmean: 1.377360 2021-03-09 18:15:35.706: INFO @log_variables: train age_loss mean: 10.435826 2021-03-09 18:15:35.706: INFO @log_variables: train gender_loss mean: 0.330812 2021-03-09 18:15:35.706: INFO @log_variables: train age_mae mean: 9.830129 2021-03-09 18:15:35.706: INFO @log_variables: train gender_accuracy mean: 0.857350 2021-03-09 18:15:35.706: INFO @log_variables: train gender_confidence/loss nanmean: 0.073143 2021-03-09 18:15:35.706: INFO @log_variables: train gender_confidence/accuracy mean: 0.757378 2021-03-09 18:15:35.706: INFO @log_variables: train age_confidence/loss mean: 0.054767 2021-03-09 18:15:35.706: INFO @log_variables: train age_confidence/accuracy mean: 0.688151 2021-03-09 18:15:35.706: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:15:35.708: INFO @metrics_hook: train age_mae: 9.830 +-0.161 (13824) 2021-03-09 18:15:35.709: INFO @metrics_hook: train gender_accuracy: 0.857 +-0.006 (13824) 2021-03-09 18:15:40.206: INFO @decay_lr : LR updated to `0.00014797054` 2021-03-09 18:15:40.207: INFO @log_profile : T train: 18.479362 2021-03-09 18:15:40.207: INFO @log_profile : T read data: 0.499477 2021-03-09 18:15:40.207: INFO @log_profile : T hooks: 4.966644 2021-03-09 18:15:40.207: INFO @main_loop : Epoch 141 done 2021-03-09 18:15:40.207: INFO @main_loop : Training epoch 142 2021-03-09 18:15:59.892: INFO @log_variables: train loss nanmean: 1.354767 2021-03-09 18:15:59.892: INFO @log_variables: train age_loss mean: 10.295641 2021-03-09 18:15:59.893: INFO @log_variables: train gender_loss mean: 0.321672 2021-03-09 18:15:59.893: INFO @log_variables: train age_mae mean: 9.689126 2021-03-09 18:15:59.893: INFO @log_variables: train gender_accuracy mean: 0.857928 2021-03-09 18:15:59.893: INFO @log_variables: train gender_confidence/loss nanmean: 0.071344 2021-03-09 18:15:59.893: INFO @log_variables: train gender_confidence/accuracy mean: 0.764540 2021-03-09 18:15:59.893: INFO @log_variables: train age_confidence/loss mean: 0.055026 2021-03-09 18:15:59.893: INFO @log_variables: train age_confidence/accuracy mean: 0.683666 2021-03-09 18:15:59.893: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:15:59.895: INFO @metrics_hook: train age_mae: 9.689 +-0.161 (13824) 2021-03-09 18:15:59.897: INFO @metrics_hook: train gender_accuracy: 0.858 +-0.006 (13824) 2021-03-09 18:16:02.049: INFO @decay_lr : LR updated to `0.00014723069` 2021-03-09 18:16:02.050: INFO @log_profile : T train: 18.761437 2021-03-09 18:16:02.050: INFO @log_profile : T read data: 0.385351 2021-03-09 18:16:02.050: INFO @log_profile : T hooks: 2.642472 2021-03-09 18:16:02.050: INFO @main_loop : Epoch 142 done 2021-03-09 18:16:02.051: INFO @main_loop : Training epoch 143 2021-03-09 18:16:21.546: INFO @log_variables: train loss nanmean: 1.353366 2021-03-09 18:16:21.547: INFO @log_variables: train age_loss mean: 10.212919 2021-03-09 18:16:21.547: INFO @log_variables: train gender_loss mean: 0.326405 2021-03-09 18:16:21.547: INFO @log_variables: train age_mae mean: 9.609131 2021-03-09 18:16:21.547: INFO @log_variables: train gender_accuracy mean: 0.860749 2021-03-09 18:16:21.547: INFO @log_variables: train gender_confidence/loss nanmean: 0.072663 2021-03-09 18:16:21.547: INFO @log_variables: train gender_confidence/accuracy mean: 0.756872 2021-03-09 18:16:21.547: INFO @log_variables: train age_confidence/loss mean: 0.055524 2021-03-09 18:16:21.547: INFO @log_variables: train age_confidence/accuracy mean: 0.683594 2021-03-09 18:16:21.547: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:16:21.549: INFO @metrics_hook: train age_mae: 9.609 +-0.159 (13824) 2021-03-09 18:16:21.551: INFO @metrics_hook: train gender_accuracy: 0.861 +-0.006 (13824) 2021-03-09 18:16:24.091: INFO @decay_lr : LR updated to `0.00014649454` 2021-03-09 18:16:24.093: INFO @log_profile : T train: 18.599851 2021-03-09 18:16:24.094: INFO @log_profile : T read data: 0.360334 2021-03-09 18:16:24.094: INFO @log_profile : T hooks: 3.030307 2021-03-09 18:16:24.094: INFO @main_loop : Epoch 143 done 2021-03-09 18:16:24.094: INFO @main_loop : Training epoch 144 2021-03-09 18:16:46.684: INFO @log_variables: train loss nanmean: 1.366634 2021-03-09 18:16:46.684: INFO @log_variables: train age_loss mean: 10.433290 2021-03-09 18:16:46.684: INFO @log_variables: train gender_loss mean: 0.321619 2021-03-09 18:16:46.684: INFO @log_variables: train age_mae mean: 9.826209 2021-03-09 18:16:46.684: INFO @log_variables: train gender_accuracy mean: 0.860605 2021-03-09 18:16:46.685: INFO @log_variables: train gender_confidence/loss nanmean: 0.071158 2021-03-09 18:16:46.685: INFO @log_variables: train gender_confidence/accuracy mean: 0.764468 2021-03-09 18:16:46.685: INFO @log_variables: train age_confidence/loss mean: 0.054614 2021-03-09 18:16:46.685: INFO @log_variables: train age_confidence/accuracy mean: 0.691479 2021-03-09 18:16:46.685: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:16:46.687: INFO @metrics_hook: train age_mae: 9.826 +-0.160 (13824) 2021-03-09 18:16:46.689: INFO @metrics_hook: train gender_accuracy: 0.861 +-0.006 (13824) 2021-03-09 18:16:49.596: INFO @decay_lr : LR updated to `0.00014576207` 2021-03-09 18:16:49.598: INFO @log_profile : T train: 21.226175 2021-03-09 18:16:49.598: INFO @log_profile : T read data: 0.789636 2021-03-09 18:16:49.598: INFO @log_profile : T hooks: 3.432475 2021-03-09 18:16:49.598: INFO @main_loop : Epoch 144 done 2021-03-09 18:16:49.598: INFO @main_loop : Training epoch 145 2021-03-09 18:17:11.817: INFO @log_variables: train loss nanmean: 1.334324 2021-03-09 18:17:11.817: INFO @log_variables: train age_loss mean: 10.122947 2021-03-09 18:17:11.817: INFO @log_variables: train gender_loss mean: 0.315389 2021-03-09 18:17:11.817: INFO @log_variables: train age_mae mean: 9.520811 2021-03-09 18:17:11.817: INFO @log_variables: train gender_accuracy mean: 0.863860 2021-03-09 18:17:11.818: INFO @log_variables: train gender_confidence/loss nanmean: 0.071519 2021-03-09 18:17:11.818: INFO @log_variables: train gender_confidence/accuracy mean: 0.764395 2021-03-09 18:17:11.818: INFO @log_variables: train age_confidence/loss mean: 0.055820 2021-03-09 18:17:11.818: INFO @log_variables: train age_confidence/accuracy mean: 0.677228 2021-03-09 18:17:11.818: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:17:11.820: INFO @metrics_hook: train age_mae: 9.521 +-0.158 (13824) 2021-03-09 18:17:11.822: INFO @metrics_hook: train gender_accuracy: 0.864 +-0.006 (13824) 2021-03-09 18:17:14.196: INFO @decay_lr : LR updated to `0.00014503326` 2021-03-09 18:17:14.197: INFO @log_profile : T train: 21.122013 2021-03-09 18:17:14.197: INFO @log_profile : T read data: 0.539470 2021-03-09 18:17:14.197: INFO @log_profile : T hooks: 2.883562 2021-03-09 18:17:14.198: INFO @main_loop : Epoch 145 done 2021-03-09 18:17:14.198: INFO @main_loop : Training epoch 146 2021-03-09 18:17:34.964: INFO @log_variables: train loss nanmean: 1.354703 2021-03-09 18:17:34.964: INFO @log_variables: train age_loss mean: 10.278456 2021-03-09 18:17:34.964: INFO @log_variables: train gender_loss mean: 0.323102 2021-03-09 18:17:34.965: INFO @log_variables: train age_mae mean: 9.673966 2021-03-09 18:17:34.965: INFO @log_variables: train gender_accuracy mean: 0.858435 2021-03-09 18:17:34.965: INFO @log_variables: train gender_confidence/loss nanmean: 0.071277 2021-03-09 18:17:34.965: INFO @log_variables: train gender_confidence/accuracy mean: 0.764034 2021-03-09 18:17:34.965: INFO @log_variables: train age_confidence/loss mean: 0.055292 2021-03-09 18:17:34.966: INFO @log_variables: train age_confidence/accuracy mean: 0.680339 2021-03-09 18:17:34.966: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:17:34.969: INFO @metrics_hook: train age_mae: 9.674 +-0.159 (13824) 2021-03-09 18:17:34.972: INFO @metrics_hook: train gender_accuracy: 0.858 +-0.006 (13824) 2021-03-09 18:17:37.845: INFO @decay_lr : LR updated to `0.0001443081` 2021-03-09 18:17:37.846: INFO @log_profile : T train: 19.810863 2021-03-09 18:17:37.846: INFO @log_profile : T read data: 0.406558 2021-03-09 18:17:37.846: INFO @log_profile : T hooks: 3.377848 2021-03-09 18:17:37.846: INFO @main_loop : Epoch 146 done 2021-03-09 18:17:37.847: INFO @main_loop : Training epoch 147 2021-03-09 18:17:57.246: INFO @log_variables: train loss nanmean: 1.343903 2021-03-09 18:17:57.247: INFO @log_variables: train age_loss mean: 10.171491 2021-03-09 18:17:57.247: INFO @log_variables: train gender_loss mean: 0.322068 2021-03-09 18:17:57.247: INFO @log_variables: train age_mae mean: 9.570471 2021-03-09 18:17:57.247: INFO @log_variables: train gender_accuracy mean: 0.857711 2021-03-09 18:17:57.247: INFO @log_variables: train gender_confidence/loss nanmean: 0.070954 2021-03-09 18:17:57.247: INFO @log_variables: train gender_confidence/accuracy mean: 0.761936 2021-03-09 18:17:57.247: INFO @log_variables: train age_confidence/loss mean: 0.055479 2021-03-09 18:17:57.247: INFO @log_variables: train age_confidence/accuracy mean: 0.682509 2021-03-09 18:17:57.247: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:17:57.248: INFO @metrics_hook: train age_mae: 9.570 +-0.157 (13824) 2021-03-09 18:17:57.250: INFO @metrics_hook: train gender_accuracy: 0.858 +-0.006 (13824) 2021-03-09 18:17:59.579: INFO @decay_lr : LR updated to `0.00014358656` 2021-03-09 18:17:59.581: INFO @log_profile : T train: 18.516395 2021-03-09 18:17:59.581: INFO @log_profile : T read data: 0.360327 2021-03-09 18:17:59.581: INFO @log_profile : T hooks: 2.803712 2021-03-09 18:17:59.581: INFO @main_loop : Epoch 147 done 2021-03-09 18:17:59.581: INFO @main_loop : Training epoch 148 2021-03-09 18:18:18.774: INFO @log_variables: train loss nanmean: 1.332356 2021-03-09 18:18:18.774: INFO @log_variables: train age_loss mean: 10.099244 2021-03-09 18:18:18.774: INFO @log_variables: train gender_loss mean: 0.316371 2021-03-09 18:18:18.774: INFO @log_variables: train age_mae mean: 9.498275 2021-03-09 18:18:18.774: INFO @log_variables: train gender_accuracy mean: 0.862413 2021-03-09 18:18:18.774: INFO @log_variables: train gender_confidence/loss nanmean: 0.071165 2021-03-09 18:18:18.774: INFO @log_variables: train gender_confidence/accuracy mean: 0.763961 2021-03-09 18:18:18.774: INFO @log_variables: train age_confidence/loss mean: 0.055468 2021-03-09 18:18:18.775: INFO @log_variables: train age_confidence/accuracy mean: 0.679326 2021-03-09 18:18:18.775: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:18:18.777: INFO @metrics_hook: train age_mae: 9.498 +-0.156 (13824) 2021-03-09 18:18:18.779: INFO @metrics_hook: train gender_accuracy: 0.862 +-0.006 (13824) 2021-03-09 18:18:20.796: INFO @decay_lr : LR updated to `0.00014286862` 2021-03-09 18:18:20.798: INFO @log_profile : T train: 18.191781 2021-03-09 18:18:20.798: INFO @log_profile : T read data: 0.446288 2021-03-09 18:18:20.798: INFO @log_profile : T hooks: 2.529031 2021-03-09 18:18:20.798: INFO @main_loop : Epoch 148 done 2021-03-09 18:18:20.798: INFO @main_loop : Training epoch 149 2021-03-09 18:18:39.662: INFO @log_variables: train loss nanmean: 1.348041 2021-03-09 18:18:39.663: INFO @log_variables: train age_loss mean: 10.167860 2021-03-09 18:18:39.663: INFO @log_variables: train gender_loss mean: 0.325734 2021-03-09 18:18:39.663: INFO @log_variables: train age_mae mean: 9.566058 2021-03-09 18:18:39.663: INFO @log_variables: train gender_accuracy mean: 0.858652 2021-03-09 18:18:39.663: INFO @log_variables: train gender_confidence/loss nanmean: 0.071792 2021-03-09 18:18:39.663: INFO @log_variables: train gender_confidence/accuracy mean: 0.754413 2021-03-09 18:18:39.663: INFO @log_variables: train age_confidence/loss mean: 0.055777 2021-03-09 18:18:39.663: INFO @log_variables: train age_confidence/accuracy mean: 0.678385 2021-03-09 18:18:39.663: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:18:39.664: INFO @metrics_hook: train age_mae: 9.566 +-0.159 (13824) 2021-03-09 18:18:39.666: INFO @metrics_hook: train gender_accuracy: 0.859 +-0.006 (13824) 2021-03-09 18:18:41.642: INFO @decay_lr : LR updated to `0.00014215428` 2021-03-09 18:18:41.643: INFO @log_profile : T train: 18.012267 2021-03-09 18:18:41.643: INFO @log_profile : T read data: 0.308277 2021-03-09 18:18:41.643: INFO @log_profile : T hooks: 2.475237 2021-03-09 18:18:41.643: INFO @main_loop : Epoch 149 done 2021-03-09 18:18:41.643: INFO @main_loop : Training epoch 150 2021-03-09 18:19:00.676: INFO @log_variables: train loss nanmean: 1.335270 2021-03-09 18:19:00.676: INFO @log_variables: train age_loss mean: 10.125844 2021-03-09 18:19:00.676: INFO @log_variables: train gender_loss mean: 0.317307 2021-03-09 18:19:00.676: INFO @log_variables: train age_mae mean: 9.529236 2021-03-09 18:19:00.676: INFO @log_variables: train gender_accuracy mean: 0.863209 2021-03-09 18:19:00.676: INFO @log_variables: train gender_confidence/loss nanmean: 0.070966 2021-03-09 18:19:00.677: INFO @log_variables: train gender_confidence/accuracy mean: 0.767723 2021-03-09 18:19:00.677: INFO @log_variables: train age_confidence/loss mean: 0.055311 2021-03-09 18:19:00.677: INFO @log_variables: train age_confidence/accuracy mean: 0.685692 2021-03-09 18:19:00.677: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:19:00.679: INFO @metrics_hook: train age_mae: 9.529 +-0.157 (13824) 2021-03-09 18:19:00.681: INFO @metrics_hook: train gender_accuracy: 0.863 +-0.006 (13824) 2021-03-09 18:19:02.693: INFO @decay_lr : LR updated to `0.00014144351` 2021-03-09 18:19:02.694: INFO @log_profile : T train: 18.153475 2021-03-09 18:19:02.694: INFO @log_profile : T read data: 0.330341 2021-03-09 18:19:02.694: INFO @log_profile : T hooks: 2.515605 2021-03-09 18:19:02.694: INFO @main_loop : Epoch 150 done 2021-03-09 18:19:02.694: INFO @main_loop : Training epoch 151 2021-03-09 18:19:21.680: INFO @log_variables: train loss nanmean: 1.345523 2021-03-09 18:19:21.680: INFO @log_variables: train age_loss mean: 10.188829 2021-03-09 18:19:21.680: INFO @log_variables: train gender_loss mean: 0.320681 2021-03-09 18:19:21.680: INFO @log_variables: train age_mae mean: 9.588869 2021-03-09 18:19:21.680: INFO @log_variables: train gender_accuracy mean: 0.863354 2021-03-09 18:19:21.680: INFO @log_variables: train gender_confidence/loss nanmean: 0.071366 2021-03-09 18:19:21.680: INFO @log_variables: train gender_confidence/accuracy mean: 0.759983 2021-03-09 18:19:21.680: INFO @log_variables: train age_confidence/loss mean: 0.056372 2021-03-09 18:19:21.680: INFO @log_variables: train age_confidence/accuracy mean: 0.673466 2021-03-09 18:19:21.680: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:19:21.682: INFO @metrics_hook: train age_mae: 9.589 +-0.161 (13824) 2021-03-09 18:19:21.683: INFO @metrics_hook: train gender_accuracy: 0.863 +-0.006 (13824) 2021-03-09 18:19:23.728: INFO @decay_lr : LR updated to `0.00014073629` 2021-03-09 18:19:23.729: INFO @log_profile : T train: 18.018310 2021-03-09 18:19:23.730: INFO @log_profile : T read data: 0.418828 2021-03-09 18:19:23.730: INFO @log_profile : T hooks: 2.549636 2021-03-09 18:19:23.730: INFO @main_loop : Epoch 151 done 2021-03-09 18:19:23.730: INFO @main_loop : Training epoch 152 2021-03-09 18:19:43.022: INFO @log_variables: train loss nanmean: 1.337320 2021-03-09 18:19:43.022: INFO @log_variables: train age_loss mean: 10.137549 2021-03-09 18:19:43.022: INFO @log_variables: train gender_loss mean: 0.317128 2021-03-09 18:19:43.022: INFO @log_variables: train age_mae mean: 9.537416 2021-03-09 18:19:43.022: INFO @log_variables: train gender_accuracy mean: 0.865451 2021-03-09 18:19:43.022: INFO @log_variables: train gender_confidence/loss nanmean: 0.071668 2021-03-09 18:19:43.022: INFO @log_variables: train gender_confidence/accuracy mean: 0.765191 2021-03-09 18:19:43.022: INFO @log_variables: train age_confidence/loss mean: 0.055758 2021-03-09 18:19:43.023: INFO @log_variables: train age_confidence/accuracy mean: 0.680049 2021-03-09 18:19:43.023: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:19:43.024: INFO @metrics_hook: train age_mae: 9.537 +-0.158 (13824) 2021-03-09 18:19:43.025: INFO @metrics_hook: train gender_accuracy: 0.865 +-0.006 (13824) 2021-03-09 18:19:45.534: INFO @decay_lr : LR updated to `0.0001400326` 2021-03-09 18:19:45.537: INFO @log_profile : T train: 18.397399 2021-03-09 18:19:45.538: INFO @log_profile : T read data: 0.365244 2021-03-09 18:19:45.539: INFO @log_profile : T hooks: 2.993373 2021-03-09 18:19:45.541: INFO @main_loop : Epoch 152 done 2021-03-09 18:19:45.542: INFO @main_loop : Training epoch 153 2021-03-09 18:20:05.543: INFO @log_variables: train loss nanmean: 1.338471 2021-03-09 18:20:05.544: INFO @log_variables: train age_loss mean: 10.174359 2021-03-09 18:20:05.544: INFO @log_variables: train gender_loss mean: 0.315424 2021-03-09 18:20:05.544: INFO @log_variables: train age_mae mean: 9.574741 2021-03-09 18:20:05.544: INFO @log_variables: train gender_accuracy mean: 0.863860 2021-03-09 18:20:05.544: INFO @log_variables: train gender_confidence/loss nanmean: 0.071236 2021-03-09 18:20:05.544: INFO @log_variables: train gender_confidence/accuracy mean: 0.765046 2021-03-09 18:20:05.544: INFO @log_variables: train age_confidence/loss mean: 0.055544 2021-03-09 18:20:05.544: INFO @log_variables: train age_confidence/accuracy mean: 0.677807 2021-03-09 18:20:05.545: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:20:05.547: INFO @metrics_hook: train age_mae: 9.575 +-0.159 (13824) 2021-03-09 18:20:05.550: INFO @metrics_hook: train gender_accuracy: 0.864 +-0.006 (13824) 2021-03-09 18:20:08.309: INFO @decay_lr : LR updated to `0.00013933243` 2021-03-09 18:20:08.310: INFO @log_profile : T train: 18.876779 2021-03-09 18:20:08.311: INFO @log_profile : T read data: 0.528473 2021-03-09 18:20:08.311: INFO @log_profile : T hooks: 3.301649 2021-03-09 18:20:08.311: INFO @main_loop : Epoch 153 done 2021-03-09 18:20:08.311: INFO @main_loop : Training epoch 154 2021-03-09 18:20:28.728: INFO @log_variables: train loss nanmean: 1.319463 2021-03-09 18:20:28.728: INFO @log_variables: train age_loss mean: 9.943546 2021-03-09 18:20:28.728: INFO @log_variables: train gender_loss mean: 0.315470 2021-03-09 18:20:28.728: INFO @log_variables: train age_mae mean: 9.349420 2021-03-09 18:20:28.728: INFO @log_variables: train gender_accuracy mean: 0.865524 2021-03-09 18:20:28.728: INFO @log_variables: train gender_confidence/loss nanmean: 0.072703 2021-03-09 18:20:28.728: INFO @log_variables: train gender_confidence/accuracy mean: 0.766710 2021-03-09 18:20:28.728: INFO @log_variables: train age_confidence/loss mean: 0.056011 2021-03-09 18:20:28.728: INFO @log_variables: train age_confidence/accuracy mean: 0.681424 2021-03-09 18:20:28.728: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:20:28.730: INFO @metrics_hook: train age_mae: 9.349 +-0.154 (13824) 2021-03-09 18:20:28.731: INFO @metrics_hook: train gender_accuracy: 0.866 +-0.006 (13824) 2021-03-09 18:20:31.415: INFO @decay_lr : LR updated to `0.00013863578` 2021-03-09 18:20:31.417: INFO @log_profile : T train: 19.168273 2021-03-09 18:20:31.417: INFO @log_profile : T read data: 0.641905 2021-03-09 18:20:31.417: INFO @log_profile : T hooks: 3.231406 2021-03-09 18:20:31.417: INFO @main_loop : Epoch 154 done 2021-03-09 18:20:31.417: INFO @main_loop : Training epoch 155 2021-03-09 18:20:51.509: INFO @log_variables: train loss nanmean: 1.332361 2021-03-09 18:20:51.511: INFO @log_variables: train age_loss mean: 10.098292 2021-03-09 18:20:51.512: INFO @log_variables: train gender_loss mean: 0.314425 2021-03-09 18:20:51.512: INFO @log_variables: train age_mae mean: 9.498908 2021-03-09 18:20:51.512: INFO @log_variables: train gender_accuracy mean: 0.862341 2021-03-09 18:20:51.512: INFO @log_variables: train gender_confidence/loss nanmean: 0.072252 2021-03-09 18:20:51.512: INFO @log_variables: train gender_confidence/accuracy mean: 0.759115 2021-03-09 18:20:51.512: INFO @log_variables: train age_confidence/loss mean: 0.056242 2021-03-09 18:20:51.512: INFO @log_variables: train age_confidence/accuracy mean: 0.680628 2021-03-09 18:20:51.512: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:20:51.514: INFO @metrics_hook: train age_mae: 9.499 +-0.159 (13824) 2021-03-09 18:20:51.515: INFO @metrics_hook: train gender_accuracy: 0.862 +-0.006 (13824) 2021-03-09 18:20:54.223: INFO @decay_lr : LR updated to `0.0001379426` 2021-03-09 18:20:54.224: INFO @log_profile : T train: 19.105585 2021-03-09 18:20:54.224: INFO @log_profile : T read data: 0.423425 2021-03-09 18:20:54.224: INFO @log_profile : T hooks: 3.223466 2021-03-09 18:20:54.225: INFO @main_loop : Epoch 155 done 2021-03-09 18:20:54.225: INFO @main_loop : Training epoch 156 2021-03-09 18:21:12.912: INFO @log_variables: train loss nanmean: 1.324161 2021-03-09 18:21:12.913: INFO @log_variables: train age_loss mean: 10.052306 2021-03-09 18:21:12.913: INFO @log_variables: train gender_loss mean: 0.310263 2021-03-09 18:21:12.913: INFO @log_variables: train age_mae mean: 9.455568 2021-03-09 18:21:12.913: INFO @log_variables: train gender_accuracy mean: 0.865162 2021-03-09 18:21:12.913: INFO @log_variables: train gender_confidence/loss nanmean: 0.071874 2021-03-09 18:21:12.913: INFO @log_variables: train gender_confidence/accuracy mean: 0.769025 2021-03-09 18:21:12.913: INFO @log_variables: train age_confidence/loss mean: 0.056383 2021-03-09 18:21:12.913: INFO @log_variables: train age_confidence/accuracy mean: 0.679109 2021-03-09 18:21:12.913: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:21:12.915: INFO @metrics_hook: train age_mae: 9.456 +-0.158 (13824) 2021-03-09 18:21:12.917: INFO @metrics_hook: train gender_accuracy: 0.865 +-0.006 (13824) 2021-03-09 18:21:15.105: INFO @decay_lr : LR updated to `0.00013725288` 2021-03-09 18:21:15.108: INFO @log_profile : T train: 17.752736 2021-03-09 18:21:15.108: INFO @log_profile : T read data: 0.349310 2021-03-09 18:21:15.108: INFO @log_profile : T hooks: 2.727928 2021-03-09 18:21:15.108: INFO @main_loop : Epoch 156 done 2021-03-09 18:21:15.108: INFO @main_loop : Training epoch 157 2021-03-09 18:21:33.865: INFO @log_variables: train loss nanmean: 1.333451 2021-03-09 18:21:33.866: INFO @log_variables: train age_loss mean: 10.089418 2021-03-09 18:21:33.866: INFO @log_variables: train gender_loss mean: 0.316632 2021-03-09 18:21:33.866: INFO @log_variables: train age_mae mean: 9.495881 2021-03-09 18:21:33.866: INFO @log_variables: train gender_accuracy mean: 0.865307 2021-03-09 18:21:33.866: INFO @log_variables: train gender_confidence/loss nanmean: 0.072589 2021-03-09 18:21:33.866: INFO @log_variables: train gender_confidence/accuracy mean: 0.757451 2021-03-09 18:21:33.867: INFO @log_variables: train age_confidence/loss mean: 0.055795 2021-03-09 18:21:33.867: INFO @log_variables: train age_confidence/accuracy mean: 0.681424 2021-03-09 18:21:33.867: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:21:33.869: INFO @metrics_hook: train age_mae: 9.496 +-0.158 (13824) 2021-03-09 18:21:33.872: INFO @metrics_hook: train gender_accuracy: 0.865 +-0.006 (13824) 2021-03-09 18:21:36.017: INFO @decay_lr : LR updated to `0.00013656661` 2021-03-09 18:21:36.019: INFO @log_profile : T train: 17.727884 2021-03-09 18:21:36.019: INFO @log_profile : T read data: 0.469827 2021-03-09 18:21:36.019: INFO @log_profile : T hooks: 2.659881 2021-03-09 18:21:36.019: INFO @main_loop : Epoch 157 done 2021-03-09 18:21:36.019: INFO @main_loop : Training epoch 158 2021-03-09 18:21:55.424: INFO @log_variables: train loss nanmean: 1.314624 2021-03-09 18:21:55.425: INFO @log_variables: train age_loss mean: 9.929254 2021-03-09 18:21:55.425: INFO @log_variables: train gender_loss mean: 0.312670 2021-03-09 18:21:55.426: INFO @log_variables: train age_mae mean: 9.334333 2021-03-09 18:21:55.426: INFO @log_variables: train gender_accuracy mean: 0.866392 2021-03-09 18:21:55.426: INFO @log_variables: train gender_confidence/loss nanmean: 0.071515 2021-03-09 18:21:55.426: INFO @log_variables: train gender_confidence/accuracy mean: 0.762659 2021-03-09 18:21:55.426: INFO @log_variables: train age_confidence/loss mean: 0.056204 2021-03-09 18:21:55.426: INFO @log_variables: train age_confidence/accuracy mean: 0.678747 2021-03-09 18:21:55.426: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:21:55.428: INFO @metrics_hook: train age_mae: 9.334 +-0.154 (13824) 2021-03-09 18:21:55.430: INFO @metrics_hook: train gender_accuracy: 0.866 +-0.006 (13824) 2021-03-09 18:21:57.896: INFO @decay_lr : LR updated to `0.00013588378` 2021-03-09 18:21:57.898: INFO @log_profile : T train: 18.499186 2021-03-09 18:21:57.898: INFO @log_profile : T read data: 0.337152 2021-03-09 18:21:57.898: INFO @log_profile : T hooks: 2.990690 2021-03-09 18:21:57.898: INFO @main_loop : Epoch 158 done 2021-03-09 18:21:57.898: INFO @main_loop : Training epoch 159 2021-03-09 18:22:17.339: INFO @log_variables: train loss nanmean: 1.309528 2021-03-09 18:22:17.339: INFO @log_variables: train age_loss mean: 9.871250 2021-03-09 18:22:17.340: INFO @log_variables: train gender_loss mean: 0.312419 2021-03-09 18:22:17.340: INFO @log_variables: train age_mae mean: 9.276331 2021-03-09 18:22:17.340: INFO @log_variables: train gender_accuracy mean: 0.863281 2021-03-09 18:22:17.340: INFO @log_variables: train gender_confidence/loss nanmean: 0.071241 2021-03-09 18:22:17.340: INFO @log_variables: train gender_confidence/accuracy mean: 0.766348 2021-03-09 18:22:17.340: INFO @log_variables: train age_confidence/loss mean: 0.056883 2021-03-09 18:22:17.340: INFO @log_variables: train age_confidence/accuracy mean: 0.674262 2021-03-09 18:22:17.340: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:22:17.343: INFO @metrics_hook: train age_mae: 9.276 +-0.155 (13824) 2021-03-09 18:22:17.345: INFO @metrics_hook: train gender_accuracy: 0.863 +-0.006 (13824) 2021-03-09 18:22:19.599: INFO @decay_lr : LR updated to `0.00013520436` 2021-03-09 18:22:19.602: INFO @log_profile : T train: 18.510634 2021-03-09 18:22:19.603: INFO @log_profile : T read data: 0.347676 2021-03-09 18:22:19.603: INFO @log_profile : T hooks: 2.792099 2021-03-09 18:22:19.603: INFO @main_loop : Epoch 159 done 2021-03-09 18:22:19.603: INFO @main_loop : Training epoch 160 2021-03-09 18:22:40.302: INFO @log_variables: train loss nanmean: 1.308247 2021-03-09 18:22:40.305: INFO @log_variables: train age_loss mean: 9.889764 2021-03-09 18:22:40.305: INFO @log_variables: train gender_loss mean: 0.310062 2021-03-09 18:22:40.305: INFO @log_variables: train age_mae mean: 9.297421 2021-03-09 18:22:40.305: INFO @log_variables: train gender_accuracy mean: 0.865813 2021-03-09 18:22:40.305: INFO @log_variables: train gender_confidence/loss nanmean: 0.070635 2021-03-09 18:22:40.305: INFO @log_variables: train gender_confidence/accuracy mean: 0.768012 2021-03-09 18:22:40.305: INFO @log_variables: train age_confidence/loss mean: 0.056668 2021-03-09 18:22:40.305: INFO @log_variables: train age_confidence/accuracy mean: 0.676505 2021-03-09 18:22:40.305: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:22:40.309: INFO @metrics_hook: train age_mae: 9.297 +-0.157 (13824) 2021-03-09 18:22:40.311: INFO @metrics_hook: train gender_accuracy: 0.866 +-0.006 (13824) 2021-03-09 18:22:43.049: INFO @decay_lr : LR updated to `0.00013452834` 2021-03-09 18:22:43.050: INFO @log_profile : T train: 19.526091 2021-03-09 18:22:43.050: INFO @log_profile : T read data: 0.589892 2021-03-09 18:22:43.050: INFO @log_profile : T hooks: 3.276647 2021-03-09 18:22:43.051: INFO @main_loop : Epoch 160 done 2021-03-09 18:22:43.051: INFO @main_loop : Training epoch 161 2021-03-09 18:23:04.445: INFO @log_variables: train loss nanmean: 1.333642 2021-03-09 18:23:04.445: INFO @log_variables: train age_loss mean: 10.133142 2021-03-09 18:23:04.445: INFO @log_variables: train gender_loss mean: 0.313393 2021-03-09 18:23:04.445: INFO @log_variables: train age_mae mean: 9.538703 2021-03-09 18:23:04.445: INFO @log_variables: train gender_accuracy mean: 0.864728 2021-03-09 18:23:04.446: INFO @log_variables: train gender_confidence/loss nanmean: 0.071488 2021-03-09 18:23:04.446: INFO @log_variables: train gender_confidence/accuracy mean: 0.767433 2021-03-09 18:23:04.446: INFO @log_variables: train age_confidence/loss mean: 0.056057 2021-03-09 18:23:04.446: INFO @log_variables: train age_confidence/accuracy mean: 0.680339 2021-03-09 18:23:04.446: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:23:04.449: INFO @metrics_hook: train age_mae: 9.539 +-0.158 (13824) 2021-03-09 18:23:04.451: INFO @metrics_hook: train gender_accuracy: 0.865 +-0.006 (13824) 2021-03-09 18:23:07.134: INFO @decay_lr : LR updated to `0.00013385569` 2021-03-09 18:23:07.136: INFO @log_profile : T train: 20.376787 2021-03-09 18:23:07.136: INFO @log_profile : T read data: 0.471456 2021-03-09 18:23:07.136: INFO @log_profile : T hooks: 3.181874 2021-03-09 18:23:07.136: INFO @main_loop : Epoch 161 done 2021-03-09 18:23:07.136: INFO @main_loop : Training epoch 162 2021-03-09 18:23:29.023: INFO @log_variables: train loss nanmean: 1.328501 2021-03-09 18:23:29.023: INFO @log_variables: train age_loss mean: 10.053331 2021-03-09 18:23:29.023: INFO @log_variables: train gender_loss mean: 0.315531 2021-03-09 18:23:29.023: INFO @log_variables: train age_mae mean: 9.457444 2021-03-09 18:23:29.023: INFO @log_variables: train gender_accuracy mean: 0.864294 2021-03-09 18:23:29.023: INFO @log_variables: train gender_confidence/loss nanmean: 0.071946 2021-03-09 18:23:29.023: INFO @log_variables: train gender_confidence/accuracy mean: 0.764395 2021-03-09 18:23:29.023: INFO @log_variables: train age_confidence/loss mean: 0.055769 2021-03-09 18:23:29.023: INFO @log_variables: train age_confidence/accuracy mean: 0.683811 2021-03-09 18:23:29.023: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:23:29.026: INFO @metrics_hook: train age_mae: 9.457 +-0.159 (13824) 2021-03-09 18:23:29.028: INFO @metrics_hook: train gender_accuracy: 0.864 +-0.006 (13824) 2021-03-09 18:23:32.242: INFO @decay_lr : LR updated to `0.00013318642` 2021-03-09 18:23:32.244: INFO @log_profile : T train: 20.740837 2021-03-09 18:23:32.244: INFO @log_profile : T read data: 0.564550 2021-03-09 18:23:32.244: INFO @log_profile : T hooks: 3.744327 2021-03-09 18:23:32.244: INFO @main_loop : Epoch 162 done 2021-03-09 18:23:32.244: INFO @main_loop : Training epoch 163 2021-03-09 18:23:53.875: INFO @log_variables: train loss nanmean: 1.317243 2021-03-09 18:23:53.875: INFO @log_variables: train age_loss mean: 10.017522 2021-03-09 18:23:53.876: INFO @log_variables: train gender_loss mean: 0.307925 2021-03-09 18:23:53.876: INFO @log_variables: train age_mae mean: 9.424743 2021-03-09 18:23:53.876: INFO @log_variables: train gender_accuracy mean: 0.868562 2021-03-09 18:23:53.876: INFO @log_variables: train gender_confidence/loss nanmean: 0.071151 2021-03-09 18:23:53.876: INFO @log_variables: train gender_confidence/accuracy mean: 0.770689 2021-03-09 18:23:53.876: INFO @log_variables: train age_confidence/loss mean: 0.055477 2021-03-09 18:23:53.876: INFO @log_variables: train age_confidence/accuracy mean: 0.680483 2021-03-09 18:23:53.876: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:23:53.878: INFO @metrics_hook: train age_mae: 9.425 +-0.156 (13824) 2021-03-09 18:23:53.880: INFO @metrics_hook: train gender_accuracy: 0.869 +-0.006 (13824) 2021-03-09 18:23:57.076: INFO @decay_lr : LR updated to `0.00013252048` 2021-03-09 18:23:57.079: INFO @log_profile : T train: 20.428699 2021-03-09 18:23:57.080: INFO @log_profile : T read data: 0.572237 2021-03-09 18:23:57.080: INFO @log_profile : T hooks: 3.775988 2021-03-09 18:23:57.080: INFO @main_loop : Epoch 163 done 2021-03-09 18:23:57.080: INFO @main_loop : Training epoch 164 2021-03-09 18:24:17.083: INFO @log_variables: train loss nanmean: 1.317681 2021-03-09 18:24:17.083: INFO @log_variables: train age_loss mean: 9.949648 2021-03-09 18:24:17.083: INFO @log_variables: train gender_loss mean: 0.313070 2021-03-09 18:24:17.083: INFO @log_variables: train age_mae mean: 9.356300 2021-03-09 18:24:17.083: INFO @log_variables: train gender_accuracy mean: 0.865885 2021-03-09 18:24:17.083: INFO @log_variables: train gender_confidence/loss nanmean: 0.072321 2021-03-09 18:24:17.083: INFO @log_variables: train gender_confidence/accuracy mean: 0.758391 2021-03-09 18:24:17.083: INFO @log_variables: train age_confidence/loss mean: 0.056237 2021-03-09 18:24:17.083: INFO @log_variables: train age_confidence/accuracy mean: 0.679977 2021-03-09 18:24:17.083: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:24:17.085: INFO @metrics_hook: train age_mae: 9.356 +-0.159 (13824) 2021-03-09 18:24:17.087: INFO @metrics_hook: train gender_accuracy: 0.866 +-0.006 (13824) 2021-03-09 18:24:19.150: INFO @decay_lr : LR updated to `0.00013185787` 2021-03-09 18:24:19.152: INFO @log_profile : T train: 18.920447 2021-03-09 18:24:19.152: INFO @log_profile : T read data: 0.520471 2021-03-09 18:24:19.152: INFO @log_profile : T hooks: 2.576882 2021-03-09 18:24:19.152: INFO @main_loop : Epoch 164 done 2021-03-09 18:24:19.152: INFO @main_loop : Training epoch 165 2021-03-09 18:24:38.175: INFO @log_variables: train loss nanmean: 1.317114 2021-03-09 18:24:38.176: INFO @log_variables: train age_loss mean: 9.984937 2021-03-09 18:24:38.176: INFO @log_variables: train gender_loss mean: 0.310037 2021-03-09 18:24:38.176: INFO @log_variables: train age_mae mean: 9.393665 2021-03-09 18:24:38.176: INFO @log_variables: train gender_accuracy mean: 0.867911 2021-03-09 18:24:38.176: INFO @log_variables: train gender_confidence/loss nanmean: 0.071698 2021-03-09 18:24:38.176: INFO @log_variables: train gender_confidence/accuracy mean: 0.771050 2021-03-09 18:24:38.176: INFO @log_variables: train age_confidence/loss mean: 0.055843 2021-03-09 18:24:38.176: INFO @log_variables: train age_confidence/accuracy mean: 0.681207 2021-03-09 18:24:38.176: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:24:38.177: INFO @metrics_hook: train age_mae: 9.394 +-0.158 (13824) 2021-03-09 18:24:38.178: INFO @metrics_hook: train gender_accuracy: 0.868 +-0.006 (13824) 2021-03-09 18:24:40.448: INFO @decay_lr : LR updated to `0.00013119858` 2021-03-09 18:24:40.450: INFO @log_profile : T train: 18.156941 2021-03-09 18:24:40.450: INFO @log_profile : T read data: 0.334334 2021-03-09 18:24:40.450: INFO @log_profile : T hooks: 2.755756 2021-03-09 18:24:40.450: INFO @main_loop : Epoch 165 done 2021-03-09 18:24:40.450: INFO @main_loop : Training epoch 166 2021-03-09 18:24:59.768: INFO @log_variables: train loss nanmean: 1.304496 2021-03-09 18:24:59.769: INFO @log_variables: train age_loss mean: 9.938451 2021-03-09 18:24:59.769: INFO @log_variables: train gender_loss mean: 0.302358 2021-03-09 18:24:59.769: INFO @log_variables: train age_mae mean: 9.349565 2021-03-09 18:24:59.769: INFO @log_variables: train gender_accuracy mean: 0.868562 2021-03-09 18:24:59.769: INFO @log_variables: train gender_confidence/loss nanmean: 0.070504 2021-03-09 18:24:59.769: INFO @log_variables: train gender_confidence/accuracy mean: 0.775174 2021-03-09 18:24:59.769: INFO @log_variables: train age_confidence/loss mean: 0.055626 2021-03-09 18:24:59.769: INFO @log_variables: train age_confidence/accuracy mean: 0.682219 2021-03-09 18:24:59.769: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:24:59.771: INFO @metrics_hook: train age_mae: 9.350 +-0.156 (13824) 2021-03-09 18:24:59.772: INFO @metrics_hook: train gender_accuracy: 0.869 +-0.006 (13824) 2021-03-09 18:25:02.057: INFO @decay_lr : LR updated to `0.0001305426` 2021-03-09 18:25:02.059: INFO @log_profile : T train: 18.425018 2021-03-09 18:25:02.059: INFO @log_profile : T read data: 0.374941 2021-03-09 18:25:02.059: INFO @log_profile : T hooks: 2.757947 2021-03-09 18:25:02.059: INFO @main_loop : Epoch 166 done 2021-03-09 18:25:02.059: INFO @main_loop : Training epoch 167 2021-03-09 18:25:21.874: INFO @log_variables: train loss nanmean: 1.305244 2021-03-09 18:25:21.874: INFO @log_variables: train age_loss mean: 9.887892 2021-03-09 18:25:21.874: INFO @log_variables: train gender_loss mean: 0.306177 2021-03-09 18:25:21.874: INFO @log_variables: train age_mae mean: 9.297201 2021-03-09 18:25:21.874: INFO @log_variables: train gender_accuracy mean: 0.868345 2021-03-09 18:25:21.874: INFO @log_variables: train gender_confidence/loss nanmean: 0.071665 2021-03-09 18:25:21.874: INFO @log_variables: train gender_confidence/accuracy mean: 0.766999 2021-03-09 18:25:21.875: INFO @log_variables: train age_confidence/loss mean: 0.056337 2021-03-09 18:25:21.875: INFO @log_variables: train age_confidence/accuracy mean: 0.676215 2021-03-09 18:25:21.875: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:25:21.876: INFO @metrics_hook: train age_mae: 9.297 +-0.155 (13824) 2021-03-09 18:25:21.878: INFO @metrics_hook: train gender_accuracy: 0.868 +-0.006 (13824) 2021-03-09 18:25:24.653: INFO @decay_lr : LR updated to `0.00012988989` 2021-03-09 18:25:24.656: INFO @log_profile : T train: 18.777442 2021-03-09 18:25:24.656: INFO @log_profile : T read data: 0.493632 2021-03-09 18:25:24.656: INFO @log_profile : T hooks: 3.271438 2021-03-09 18:25:24.656: INFO @main_loop : Epoch 167 done 2021-03-09 18:25:24.657: INFO @main_loop : Training epoch 168 2021-03-09 18:25:44.162: INFO @log_variables: train loss nanmean: 1.297167 2021-03-09 18:25:44.163: INFO @log_variables: train age_loss mean: 9.881618 2021-03-09 18:25:44.163: INFO @log_variables: train gender_loss mean: 0.301142 2021-03-09 18:25:44.163: INFO @log_variables: train age_mae mean: 9.293164 2021-03-09 18:25:44.163: INFO @log_variables: train gender_accuracy mean: 0.867839 2021-03-09 18:25:44.163: INFO @log_variables: train gender_confidence/loss nanmean: 0.069324 2021-03-09 18:25:44.163: INFO @log_variables: train gender_confidence/accuracy mean: 0.776982 2021-03-09 18:25:44.163: INFO @log_variables: train age_confidence/loss mean: 0.055750 2021-03-09 18:25:44.163: INFO @log_variables: train age_confidence/accuracy mean: 0.682870 2021-03-09 18:25:44.164: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:25:44.166: INFO @metrics_hook: train age_mae: 9.293 +-0.156 (13824) 2021-03-09 18:25:44.168: INFO @metrics_hook: train gender_accuracy: 0.868 +-0.006 (13824) 2021-03-09 18:25:46.593: INFO @decay_lr : LR updated to `0.00012924043` 2021-03-09 18:25:46.594: INFO @log_profile : T train: 18.579781 2021-03-09 18:25:46.595: INFO @log_profile : T read data: 0.350468 2021-03-09 18:25:46.595: INFO @log_profile : T hooks: 2.953856 2021-03-09 18:25:46.595: INFO @main_loop : Epoch 168 done 2021-03-09 18:25:46.595: INFO @main_loop : Training epoch 169 2021-03-09 18:26:07.647: INFO @log_variables: train loss nanmean: 1.293182 2021-03-09 18:26:07.647: INFO @log_variables: train age_loss mean: 9.690464 2021-03-09 18:26:07.647: INFO @log_variables: train gender_loss mean: 0.312788 2021-03-09 18:26:07.647: INFO @log_variables: train age_mae mean: 9.101634 2021-03-09 18:26:07.647: INFO @log_variables: train gender_accuracy mean: 0.862124 2021-03-09 18:26:07.647: INFO @log_variables: train gender_confidence/loss nanmean: 0.070703 2021-03-09 18:26:07.647: INFO @log_variables: train gender_confidence/accuracy mean: 0.766638 2021-03-09 18:26:07.647: INFO @log_variables: train age_confidence/loss mean: 0.057175 2021-03-09 18:26:07.648: INFO @log_variables: train age_confidence/accuracy mean: 0.671296 2021-03-09 18:26:07.648: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:26:07.649: INFO @metrics_hook: train age_mae: 9.102 +-0.152 (13824) 2021-03-09 18:26:07.651: INFO @metrics_hook: train gender_accuracy: 0.862 +-0.006 (13824) 2021-03-09 18:26:10.565: INFO @decay_lr : LR updated to `0.00012859423` 2021-03-09 18:26:10.567: INFO @log_profile : T train: 19.928694 2021-03-09 18:26:10.567: INFO @log_profile : T read data: 0.537379 2021-03-09 18:26:10.567: INFO @log_profile : T hooks: 3.447934 2021-03-09 18:26:10.567: INFO @main_loop : Epoch 169 done 2021-03-09 18:26:10.567: INFO @main_loop : Training epoch 170 2021-03-09 18:26:32.194: INFO @log_variables: train loss nanmean: 1.310126 2021-03-09 18:26:32.195: INFO @log_variables: train age_loss mean: 9.906439 2021-03-09 18:26:32.195: INFO @log_variables: train gender_loss mean: 0.309470 2021-03-09 18:26:32.195: INFO @log_variables: train age_mae mean: 9.315190 2021-03-09 18:26:32.195: INFO @log_variables: train gender_accuracy mean: 0.869213 2021-03-09 18:26:32.195: INFO @log_variables: train gender_confidence/loss nanmean: 0.072288 2021-03-09 18:26:32.195: INFO @log_variables: train gender_confidence/accuracy mean: 0.768157 2021-03-09 18:26:32.195: INFO @log_variables: train age_confidence/loss mean: 0.055917 2021-03-09 18:26:32.195: INFO @log_variables: train age_confidence/accuracy mean: 0.680266 2021-03-09 18:26:32.195: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:26:32.197: INFO @metrics_hook: train age_mae: 9.315 +-0.157 (13824) 2021-03-09 18:26:32.199: INFO @metrics_hook: train gender_accuracy: 0.869 +-0.006 (13824) 2021-03-09 18:26:35.268: INFO @decay_lr : LR updated to `0.00012795125` 2021-03-09 18:26:35.270: INFO @log_profile : T train: 20.342418 2021-03-09 18:26:35.270: INFO @log_profile : T read data: 0.691007 2021-03-09 18:26:35.270: INFO @log_profile : T hooks: 3.608064 2021-03-09 18:26:35.270: INFO @main_loop : Epoch 170 done 2021-03-09 18:26:35.270: INFO @main_loop : Training epoch 171 2021-03-09 18:26:56.394: INFO @log_variables: train loss nanmean: 1.279078 2021-03-09 18:26:56.394: INFO @log_variables: train age_loss mean: 9.606061 2021-03-09 18:26:56.394: INFO @log_variables: train gender_loss mean: 0.305538 2021-03-09 18:26:56.394: INFO @log_variables: train age_mae mean: 9.021181 2021-03-09 18:26:56.395: INFO @log_variables: train gender_accuracy mean: 0.865741 2021-03-09 18:26:56.395: INFO @log_variables: train gender_confidence/loss nanmean: 0.070458 2021-03-09 18:26:56.395: INFO @log_variables: train gender_confidence/accuracy mean: 0.770110 2021-03-09 18:26:56.395: INFO @log_variables: train age_confidence/loss mean: 0.057580 2021-03-09 18:26:56.395: INFO @log_variables: train age_confidence/accuracy mean: 0.670935 2021-03-09 18:26:56.395: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:26:56.397: INFO @metrics_hook: train age_mae: 9.021 +-0.151 (13824) 2021-03-09 18:26:56.399: INFO @metrics_hook: train gender_accuracy: 0.866 +-0.006 (13824) 2021-03-09 18:26:59.299: INFO @decay_lr : LR updated to `0.00012731149` 2021-03-09 18:26:59.300: INFO @log_profile : T train: 20.020680 2021-03-09 18:26:59.301: INFO @log_profile : T read data: 0.488036 2021-03-09 18:26:59.301: INFO @log_profile : T hooks: 3.459470 2021-03-09 18:26:59.301: INFO @main_loop : Epoch 171 done 2021-03-09 18:26:59.301: INFO @main_loop : Training epoch 172 2021-03-09 18:27:20.645: INFO @log_variables: train loss nanmean: 1.312034 2021-03-09 18:27:20.645: INFO @log_variables: train age_loss mean: 9.953126 2021-03-09 18:27:20.645: INFO @log_variables: train gender_loss mean: 0.306663 2021-03-09 18:27:20.645: INFO @log_variables: train age_mae mean: 9.356733 2021-03-09 18:27:20.645: INFO @log_variables: train gender_accuracy mean: 0.870081 2021-03-09 18:27:20.645: INFO @log_variables: train gender_confidence/loss nanmean: 0.072044 2021-03-09 18:27:20.645: INFO @log_variables: train gender_confidence/accuracy mean: 0.765191 2021-03-09 18:27:20.645: INFO @log_variables: train age_confidence/loss mean: 0.056376 2021-03-09 18:27:20.645: INFO @log_variables: train age_confidence/accuracy mean: 0.676360 2021-03-09 18:27:20.645: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:27:20.647: INFO @metrics_hook: train age_mae: 9.357 +-0.157 (13824) 2021-03-09 18:27:20.649: INFO @metrics_hook: train gender_accuracy: 0.870 +-0.006 (13824) 2021-03-09 18:27:23.108: INFO @decay_lr : LR updated to `0.00012667493` 2021-03-09 18:27:23.109: INFO @log_profile : T train: 20.255286 2021-03-09 18:27:23.109: INFO @log_profile : T read data: 0.496621 2021-03-09 18:27:23.109: INFO @log_profile : T hooks: 2.994112 2021-03-09 18:27:23.110: INFO @main_loop : Epoch 172 done 2021-03-09 18:27:23.110: INFO @main_loop : Training epoch 173 2021-03-09 18:27:42.752: INFO @log_variables: train loss nanmean: 1.303903 2021-03-09 18:27:42.752: INFO @log_variables: train age_loss mean: 9.973045 2021-03-09 18:27:42.752: INFO @log_variables: train gender_loss mean: 0.297784 2021-03-09 18:27:42.752: INFO @log_variables: train age_mae mean: 9.381264 2021-03-09 18:27:42.752: INFO @log_variables: train gender_accuracy mean: 0.875145 2021-03-09 18:27:42.752: INFO @log_variables: train gender_confidence/loss nanmean: 0.071004 2021-03-09 18:27:42.752: INFO @log_variables: train gender_confidence/accuracy mean: 0.774884 2021-03-09 18:27:42.752: INFO @log_variables: train age_confidence/loss mean: 0.055546 2021-03-09 18:27:42.752: INFO @log_variables: train age_confidence/accuracy mean: 0.682292 2021-03-09 18:27:42.753: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:27:42.754: INFO @metrics_hook: train age_mae: 9.381 +-0.156 (13824) 2021-03-09 18:27:42.756: INFO @metrics_hook: train gender_accuracy: 0.875 +-0.006 (13824) 2021-03-09 18:27:44.848: INFO @decay_lr : LR updated to `0.00012604156` 2021-03-09 18:27:44.849: INFO @log_profile : T train: 18.563947 2021-03-09 18:27:44.849: INFO @log_profile : T read data: 0.467363 2021-03-09 18:27:44.850: INFO @log_profile : T hooks: 2.654572 2021-03-09 18:27:44.850: INFO @main_loop : Epoch 173 done 2021-03-09 18:27:44.850: INFO @main_loop : Training epoch 174 2021-03-09 18:28:04.350: INFO @log_variables: train loss nanmean: 1.285901 2021-03-09 18:28:04.351: INFO @log_variables: train age_loss mean: 9.696918 2021-03-09 18:28:04.351: INFO @log_variables: train gender_loss mean: 0.303788 2021-03-09 18:28:04.351: INFO @log_variables: train age_mae mean: 9.110983 2021-03-09 18:28:04.351: INFO @log_variables: train gender_accuracy mean: 0.870226 2021-03-09 18:28:04.351: INFO @log_variables: train gender_confidence/loss nanmean: 0.071382 2021-03-09 18:28:04.352: INFO @log_variables: train gender_confidence/accuracy mean: 0.766999 2021-03-09 18:28:04.352: INFO @log_variables: train age_confidence/loss mean: 0.056810 2021-03-09 18:28:04.352: INFO @log_variables: train age_confidence/accuracy mean: 0.677951 2021-03-09 18:28:04.352: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:28:04.358: INFO @metrics_hook: train age_mae: 9.111 +-0.152 (13824) 2021-03-09 18:28:04.364: INFO @metrics_hook: train gender_accuracy: 0.870 +-0.006 (13824) 2021-03-09 18:28:06.685: INFO @decay_lr : LR updated to `0.00012541134` 2021-03-09 18:28:06.686: INFO @log_profile : T train: 18.581468 2021-03-09 18:28:06.686: INFO @log_profile : T read data: 0.334067 2021-03-09 18:28:06.687: INFO @log_profile : T hooks: 2.868091 2021-03-09 18:28:06.687: INFO @main_loop : Epoch 174 done 2021-03-09 18:28:06.687: INFO @main_loop : Training epoch 175 2021-03-09 18:28:26.093: INFO @log_variables: train loss nanmean: 1.295974 2021-03-09 18:28:26.093: INFO @log_variables: train age_loss mean: 9.829720 2021-03-09 18:28:26.093: INFO @log_variables: train gender_loss mean: 0.302145 2021-03-09 18:28:26.093: INFO @log_variables: train age_mae mean: 9.242002 2021-03-09 18:28:26.093: INFO @log_variables: train gender_accuracy mean: 0.869213 2021-03-09 18:28:26.093: INFO @log_variables: train gender_confidence/loss nanmean: 0.071569 2021-03-09 18:28:26.093: INFO @log_variables: train gender_confidence/accuracy mean: 0.769242 2021-03-09 18:28:26.093: INFO @log_variables: train age_confidence/loss mean: 0.056117 2021-03-09 18:28:26.094: INFO @log_variables: train age_confidence/accuracy mean: 0.680990 2021-03-09 18:28:26.094: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:28:26.096: INFO @metrics_hook: train age_mae: 9.242 +-0.153 (13824) 2021-03-09 18:28:26.098: INFO @metrics_hook: train gender_accuracy: 0.869 +-0.006 (13824) 2021-03-09 18:28:28.172: INFO @decay_lr : LR updated to `0.00012478429` 2021-03-09 18:28:28.173: INFO @log_profile : T train: 18.504285 2021-03-09 18:28:28.173: INFO @log_profile : T read data: 0.332623 2021-03-09 18:28:28.173: INFO @log_profile : T hooks: 2.597237 2021-03-09 18:28:28.173: INFO @main_loop : Epoch 175 done 2021-03-09 18:28:28.173: INFO @main_loop : Training epoch 176 2021-03-09 18:28:47.357: INFO @log_variables: train loss nanmean: 1.295101 2021-03-09 18:28:47.357: INFO @log_variables: train age_loss mean: 9.759620 2021-03-09 18:28:47.357: INFO @log_variables: train gender_loss mean: 0.308319 2021-03-09 18:28:47.357: INFO @log_variables: train age_mae mean: 9.170149 2021-03-09 18:28:47.357: INFO @log_variables: train gender_accuracy mean: 0.867911 2021-03-09 18:28:47.358: INFO @log_variables: train gender_confidence/loss nanmean: 0.070699 2021-03-09 18:28:47.358: INFO @log_variables: train gender_confidence/accuracy mean: 0.769314 2021-03-09 18:28:47.358: INFO @log_variables: train age_confidence/loss mean: 0.056873 2021-03-09 18:28:47.358: INFO @log_variables: train age_confidence/accuracy mean: 0.669850 2021-03-09 18:28:47.358: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:28:47.360: INFO @metrics_hook: train age_mae: 9.170 +-0.154 (13824) 2021-03-09 18:28:47.362: INFO @metrics_hook: train gender_accuracy: 0.868 +-0.006 (13824) 2021-03-09 18:28:49.469: INFO @decay_lr : LR updated to `0.00012416036` 2021-03-09 18:28:49.471: INFO @log_profile : T train: 18.175690 2021-03-09 18:28:49.471: INFO @log_profile : T read data: 0.450258 2021-03-09 18:28:49.471: INFO @log_profile : T hooks: 2.621910 2021-03-09 18:28:49.471: INFO @main_loop : Epoch 176 done 2021-03-09 18:28:49.471: INFO @main_loop : Training epoch 177 2021-03-09 18:29:08.725: INFO @log_variables: train loss nanmean: 1.293619 2021-03-09 18:29:08.726: INFO @log_variables: train age_loss mean: 9.780570 2021-03-09 18:29:08.726: INFO @log_variables: train gender_loss mean: 0.303773 2021-03-09 18:29:08.726: INFO @log_variables: train age_mae mean: 9.192176 2021-03-09 18:29:08.726: INFO @log_variables: train gender_accuracy mean: 0.870443 2021-03-09 18:29:08.726: INFO @log_variables: train gender_confidence/loss nanmean: 0.071767 2021-03-09 18:29:08.726: INFO @log_variables: train gender_confidence/accuracy mean: 0.770255 2021-03-09 18:29:08.726: INFO @log_variables: train age_confidence/loss mean: 0.056552 2021-03-09 18:29:08.726: INFO @log_variables: train age_confidence/accuracy mean: 0.671441 2021-03-09 18:29:08.726: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:29:08.729: INFO @metrics_hook: train age_mae: 9.192 +-0.156 (13824) 2021-03-09 18:29:08.732: INFO @metrics_hook: train gender_accuracy: 0.870 +-0.006 (13824) 2021-03-09 18:29:11.263: INFO @decay_lr : LR updated to `0.00012353956` 2021-03-09 18:29:11.265: INFO @log_profile : T train: 18.342347 2021-03-09 18:29:11.265: INFO @log_profile : T read data: 0.361813 2021-03-09 18:29:11.265: INFO @log_profile : T hooks: 3.037743 2021-03-09 18:29:11.265: INFO @main_loop : Epoch 177 done 2021-03-09 18:29:11.265: INFO @main_loop : Training epoch 178 2021-03-09 18:29:30.757: INFO @log_variables: train loss nanmean: 1.289703 2021-03-09 18:29:30.757: INFO @log_variables: train age_loss mean: 9.787293 2021-03-09 18:29:30.757: INFO @log_variables: train gender_loss mean: 0.300896 2021-03-09 18:29:30.757: INFO @log_variables: train age_mae mean: 9.200665 2021-03-09 18:29:30.757: INFO @log_variables: train gender_accuracy mean: 0.871889 2021-03-09 18:29:30.757: INFO @log_variables: train gender_confidence/loss nanmean: 0.070211 2021-03-09 18:29:30.757: INFO @log_variables: train gender_confidence/accuracy mean: 0.771123 2021-03-09 18:29:30.757: INFO @log_variables: train age_confidence/loss mean: 0.056196 2021-03-09 18:29:30.758: INFO @log_variables: train age_confidence/accuracy mean: 0.678892 2021-03-09 18:29:30.758: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:29:30.759: INFO @metrics_hook: train age_mae: 9.201 +-0.154 (13824) 2021-03-09 18:29:30.760: INFO @metrics_hook: train gender_accuracy: 0.872 +-0.006 (13824) 2021-03-09 18:29:36.013: INFO @decay_lr : LR updated to `0.00012292186` 2021-03-09 18:29:36.015: INFO @log_profile : T train: 18.596140 2021-03-09 18:29:36.015: INFO @log_profile : T read data: 0.373527 2021-03-09 18:29:36.015: INFO @log_profile : T hooks: 5.727530 2021-03-09 18:29:36.016: INFO @main_loop : Epoch 178 done 2021-03-09 18:29:36.016: INFO @main_loop : Training epoch 179 2021-03-09 18:29:55.300: INFO @log_variables: train loss nanmean: 1.273474 2021-03-09 18:29:55.300: INFO @log_variables: train age_loss mean: 9.679692 2021-03-09 18:29:55.300: INFO @log_variables: train gender_loss mean: 0.291547 2021-03-09 18:29:55.300: INFO @log_variables: train age_mae mean: 9.092750 2021-03-09 18:29:55.300: INFO @log_variables: train gender_accuracy mean: 0.877170 2021-03-09 18:29:55.300: INFO @log_variables: train gender_confidence/loss nanmean: 0.071322 2021-03-09 18:29:55.300: INFO @log_variables: train gender_confidence/accuracy mean: 0.770110 2021-03-09 18:29:55.300: INFO @log_variables: train age_confidence/loss mean: 0.057138 2021-03-09 18:29:55.300: INFO @log_variables: train age_confidence/accuracy mean: 0.673105 2021-03-09 18:29:55.300: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:29:55.302: INFO @metrics_hook: train age_mae: 9.093 +-0.153 (13824) 2021-03-09 18:29:55.305: INFO @metrics_hook: train gender_accuracy: 0.877 +-0.006 (13824) 2021-03-09 18:29:57.631: INFO @decay_lr : LR updated to `0.00012230725` 2021-03-09 18:29:57.632: INFO @log_profile : T train: 18.426005 2021-03-09 18:29:57.632: INFO @log_profile : T read data: 0.344168 2021-03-09 18:29:57.632: INFO @log_profile : T hooks: 2.795099 2021-03-09 18:29:57.632: INFO @main_loop : Epoch 179 done 2021-03-09 18:29:57.633: INFO @main_loop : Training epoch 180 2021-03-09 18:30:17.138: INFO @log_variables: train loss nanmean: 1.276090 2021-03-09 18:30:17.138: INFO @log_variables: train age_loss mean: 9.692130 2021-03-09 18:30:17.138: INFO @log_variables: train gender_loss mean: 0.295086 2021-03-09 18:30:17.138: INFO @log_variables: train age_mae mean: 9.107375 2021-03-09 18:30:17.138: INFO @log_variables: train gender_accuracy mean: 0.876230 2021-03-09 18:30:17.138: INFO @log_variables: train gender_confidence/loss nanmean: 0.070135 2021-03-09 18:30:17.139: INFO @log_variables: train gender_confidence/accuracy mean: 0.770472 2021-03-09 18:30:17.139: INFO @log_variables: train age_confidence/loss mean: 0.056592 2021-03-09 18:30:17.139: INFO @log_variables: train age_confidence/accuracy mean: 0.675781 2021-03-09 18:30:17.139: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:30:17.141: INFO @metrics_hook: train age_mae: 9.107 +-0.152 (13824) 2021-03-09 18:30:17.142: INFO @metrics_hook: train gender_accuracy: 0.876 +-0.006 (13824) 2021-03-09 18:30:19.452: INFO @decay_lr : LR updated to `0.00012169571` 2021-03-09 18:30:19.453: INFO @log_profile : T train: 18.486145 2021-03-09 18:30:19.453: INFO @log_profile : T read data: 0.483689 2021-03-09 18:30:19.453: INFO @log_profile : T hooks: 2.799303 2021-03-09 18:30:19.453: INFO @main_loop : Epoch 180 done 2021-03-09 18:30:19.453: INFO @main_loop : Training epoch 181 2021-03-09 18:30:38.394: INFO @log_variables: train loss nanmean: 1.296213 2021-03-09 18:30:38.394: INFO @log_variables: train age_loss mean: 9.882672 2021-03-09 18:30:38.394: INFO @log_variables: train gender_loss mean: 0.298657 2021-03-09 18:30:38.394: INFO @log_variables: train age_mae mean: 9.293825 2021-03-09 18:30:38.394: INFO @log_variables: train gender_accuracy mean: 0.870226 2021-03-09 18:30:38.395: INFO @log_variables: train gender_confidence/loss nanmean: 0.070036 2021-03-09 18:30:38.395: INFO @log_variables: train gender_confidence/accuracy mean: 0.771846 2021-03-09 18:30:38.395: INFO @log_variables: train age_confidence/loss mean: 0.056246 2021-03-09 18:30:38.395: INFO @log_variables: train age_confidence/accuracy mean: 0.675130 2021-03-09 18:30:38.395: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:30:38.397: INFO @metrics_hook: train age_mae: 9.294 +-0.158 (13824) 2021-03-09 18:30:38.399: INFO @metrics_hook: train gender_accuracy: 0.870 +-0.006 (13824) 2021-03-09 18:30:40.460: INFO @decay_lr : LR updated to `0.00012108723` 2021-03-09 18:30:40.462: INFO @log_profile : T train: 18.050733 2021-03-09 18:30:40.462: INFO @log_profile : T read data: 0.313924 2021-03-09 18:30:40.462: INFO @log_profile : T hooks: 2.593056 2021-03-09 18:30:40.462: INFO @main_loop : Epoch 181 done 2021-03-09 18:30:40.462: INFO @main_loop : Training epoch 182 2021-03-09 18:30:59.414: INFO @log_variables: train loss nanmean: 1.280506 2021-03-09 18:30:59.414: INFO @log_variables: train age_loss mean: 9.672517 2021-03-09 18:30:59.414: INFO @log_variables: train gender_loss mean: 0.301971 2021-03-09 18:30:59.414: INFO @log_variables: train age_mae mean: 9.090594 2021-03-09 18:30:59.414: INFO @log_variables: train gender_accuracy mean: 0.870443 2021-03-09 18:30:59.414: INFO @log_variables: train gender_confidence/loss nanmean: 0.070416 2021-03-09 18:30:59.414: INFO @log_variables: train gender_confidence/accuracy mean: 0.772569 2021-03-09 18:30:59.414: INFO @log_variables: train age_confidence/loss mean: 0.056251 2021-03-09 18:30:59.414: INFO @log_variables: train age_confidence/accuracy mean: 0.673828 2021-03-09 18:30:59.414: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:30:59.416: INFO @metrics_hook: train age_mae: 9.091 +-0.152 (13824) 2021-03-09 18:30:59.417: INFO @metrics_hook: train gender_accuracy: 0.870 +-0.006 (13824) 2021-03-09 18:31:01.569: INFO @decay_lr : LR updated to `0.00012048179` 2021-03-09 18:31:01.570: INFO @log_profile : T train: 18.095025 2021-03-09 18:31:01.570: INFO @log_profile : T read data: 0.313536 2021-03-09 18:31:01.571: INFO @log_profile : T hooks: 2.650322 2021-03-09 18:31:01.571: INFO @main_loop : Epoch 182 done 2021-03-09 18:31:01.571: INFO @main_loop : Training epoch 183 2021-03-09 18:31:20.943: INFO @log_variables: train loss nanmean: 1.286070 2021-03-09 18:31:20.943: INFO @log_variables: train age_loss mean: 9.655656 2021-03-09 18:31:20.943: INFO @log_variables: train gender_loss mean: 0.308179 2021-03-09 18:31:20.943: INFO @log_variables: train age_mae mean: 9.072371 2021-03-09 18:31:20.943: INFO @log_variables: train gender_accuracy mean: 0.867983 2021-03-09 18:31:20.943: INFO @log_variables: train gender_confidence/loss nanmean: 0.071837 2021-03-09 18:31:20.943: INFO @log_variables: train gender_confidence/accuracy mean: 0.768519 2021-03-09 18:31:20.943: INFO @log_variables: train age_confidence/loss mean: 0.056284 2021-03-09 18:31:20.943: INFO @log_variables: train age_confidence/accuracy mean: 0.680122 2021-03-09 18:31:20.944: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:31:20.946: INFO @metrics_hook: train age_mae: 9.072 +-0.153 (13824) 2021-03-09 18:31:20.949: INFO @metrics_hook: train gender_accuracy: 0.868 +-0.006 (13824) 2021-03-09 18:31:23.154: INFO @decay_lr : LR updated to `0.00011987938` 2021-03-09 18:31:23.155: INFO @log_profile : T train: 18.396294 2021-03-09 18:31:23.156: INFO @log_profile : T read data: 0.457900 2021-03-09 18:31:23.156: INFO @log_profile : T hooks: 2.680383 2021-03-09 18:31:23.156: INFO @main_loop : Epoch 183 done 2021-03-09 18:31:23.156: INFO @main_loop : Training epoch 184 2021-03-09 18:31:42.454: INFO @log_variables: train loss nanmean: 1.302192 2021-03-09 18:31:42.454: INFO @log_variables: train age_loss mean: 9.830876 2021-03-09 18:31:42.454: INFO @log_variables: train gender_loss mean: 0.307407 2021-03-09 18:31:42.454: INFO @log_variables: train age_mae mean: 9.242275 2021-03-09 18:31:42.454: INFO @log_variables: train gender_accuracy mean: 0.870298 2021-03-09 18:31:42.454: INFO @log_variables: train gender_confidence/loss nanmean: 0.071639 2021-03-09 18:31:42.454: INFO @log_variables: train gender_confidence/accuracy mean: 0.763166 2021-03-09 18:31:42.454: INFO @log_variables: train age_confidence/loss mean: 0.057376 2021-03-09 18:31:42.454: INFO @log_variables: train age_confidence/accuracy mean: 0.673105 2021-03-09 18:31:42.454: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:31:42.456: INFO @metrics_hook: train age_mae: 9.242 +-0.155 (13824) 2021-03-09 18:31:42.458: INFO @metrics_hook: train gender_accuracy: 0.870 +-0.006 (13824) 2021-03-09 18:31:44.735: INFO @decay_lr : LR updated to `0.00011927999` 2021-03-09 18:31:44.736: INFO @log_profile : T train: 18.397782 2021-03-09 18:31:44.737: INFO @log_profile : T read data: 0.372598 2021-03-09 18:31:44.737: INFO @log_profile : T hooks: 2.756910 2021-03-09 18:31:44.737: INFO @main_loop : Epoch 184 done 2021-03-09 18:31:44.737: INFO @main_loop : Training epoch 185 2021-03-09 18:32:05.435: INFO @log_variables: train loss nanmean: 1.289844 2021-03-09 18:32:05.436: INFO @log_variables: train age_loss mean: 9.704094 2021-03-09 18:32:05.436: INFO @log_variables: train gender_loss mean: 0.306438 2021-03-09 18:32:05.436: INFO @log_variables: train age_mae mean: 9.118889 2021-03-09 18:32:05.436: INFO @log_variables: train gender_accuracy mean: 0.871672 2021-03-09 18:32:05.436: INFO @log_variables: train gender_confidence/loss nanmean: 0.072399 2021-03-09 18:32:05.436: INFO @log_variables: train gender_confidence/accuracy mean: 0.764757 2021-03-09 18:32:05.436: INFO @log_variables: train age_confidence/loss mean: 0.056674 2021-03-09 18:32:05.436: INFO @log_variables: train age_confidence/accuracy mean: 0.675203 2021-03-09 18:32:05.436: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:32:05.439: INFO @metrics_hook: train age_mae: 9.119 +-0.152 (13824) 2021-03-09 18:32:05.441: INFO @metrics_hook: train gender_accuracy: 0.872 +-0.006 (13824) 2021-03-09 18:32:08.343: INFO @decay_lr : LR updated to `0.00011868359` 2021-03-09 18:32:08.345: INFO @log_profile : T train: 19.710328 2021-03-09 18:32:08.345: INFO @log_profile : T read data: 0.423717 2021-03-09 18:32:08.345: INFO @log_profile : T hooks: 3.418564 2021-03-09 18:32:08.345: INFO @main_loop : Epoch 185 done 2021-03-09 18:32:08.345: INFO @main_loop : Training epoch 186 2021-03-09 18:32:29.392: INFO @log_variables: train loss nanmean: 1.263155 2021-03-09 18:32:29.393: INFO @log_variables: train age_loss mean: 9.527905 2021-03-09 18:32:29.394: INFO @log_variables: train gender_loss mean: 0.295634 2021-03-09 18:32:29.395: INFO @log_variables: train age_mae mean: 8.949272 2021-03-09 18:32:29.395: INFO @log_variables: train gender_accuracy mean: 0.874494 2021-03-09 18:32:29.396: INFO @log_variables: train gender_confidence/loss nanmean: 0.071240 2021-03-09 18:32:29.396: INFO @log_variables: train gender_confidence/accuracy mean: 0.770978 2021-03-09 18:32:29.399: INFO @log_variables: train age_confidence/loss mean: 0.056984 2021-03-09 18:32:29.401: INFO @log_variables: train age_confidence/accuracy mean: 0.676360 2021-03-09 18:32:29.402: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:32:29.406: INFO @metrics_hook: train age_mae: 8.949 +-0.151 (13824) 2021-03-09 18:32:29.409: INFO @metrics_hook: train gender_accuracy: 0.874 +-0.006 (13824) 2021-03-09 18:32:32.283: INFO @decay_lr : LR updated to `0.00011809017` 2021-03-09 18:32:32.285: INFO @log_profile : T train: 19.921374 2021-03-09 18:32:32.285: INFO @log_profile : T read data: 0.570622 2021-03-09 18:32:32.285: INFO @log_profile : T hooks: 3.390002 2021-03-09 18:32:32.285: INFO @main_loop : Epoch 186 done 2021-03-09 18:32:32.285: INFO @main_loop : Training epoch 187 2021-03-09 18:32:54.558: INFO @log_variables: train loss nanmean: 1.277794 2021-03-09 18:32:54.559: INFO @log_variables: train age_loss mean: 9.709029 2021-03-09 18:32:54.559: INFO @log_variables: train gender_loss mean: 0.294513 2021-03-09 18:32:54.559: INFO @log_variables: train age_mae mean: 9.125028 2021-03-09 18:32:54.559: INFO @log_variables: train gender_accuracy mean: 0.873843 2021-03-09 18:32:54.559: INFO @log_variables: train gender_confidence/loss nanmean: 0.070792 2021-03-09 18:32:54.559: INFO @log_variables: train gender_confidence/accuracy mean: 0.771774 2021-03-09 18:32:54.559: INFO @log_variables: train age_confidence/loss mean: 0.056624 2021-03-09 18:32:54.559: INFO @log_variables: train age_confidence/accuracy mean: 0.677590 2021-03-09 18:32:54.559: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:32:54.562: INFO @metrics_hook: train age_mae: 9.125 +-0.152 (13824) 2021-03-09 18:32:54.564: INFO @metrics_hook: train gender_accuracy: 0.874 +-0.006 (13824) 2021-03-09 18:32:57.672: INFO @decay_lr : LR updated to `0.000117499716` 2021-03-09 18:32:57.674: INFO @log_profile : T train: 21.080349 2021-03-09 18:32:57.676: INFO @log_profile : T read data: 0.600971 2021-03-09 18:32:57.677: INFO @log_profile : T hooks: 3.649727 2021-03-09 18:32:57.677: INFO @main_loop : Epoch 187 done 2021-03-09 18:32:57.677: INFO @main_loop : Training epoch 188 2021-03-09 18:33:20.979: INFO @log_variables: train loss nanmean: 1.282532 2021-03-09 18:33:20.981: INFO @log_variables: train age_loss mean: 9.794137 2021-03-09 18:33:20.984: INFO @log_variables: train gender_loss mean: 0.292716 2021-03-09 18:33:20.985: INFO @log_variables: train age_mae mean: 9.207437 2021-03-09 18:33:20.986: INFO @log_variables: train gender_accuracy mean: 0.874638 2021-03-09 18:33:20.988: INFO @log_variables: train gender_confidence/loss nanmean: 0.069923 2021-03-09 18:33:20.989: INFO @log_variables: train gender_confidence/accuracy mean: 0.776042 2021-03-09 18:33:20.991: INFO @log_variables: train age_confidence/loss mean: 0.056127 2021-03-09 18:33:20.991: INFO @log_variables: train age_confidence/accuracy mean: 0.680628 2021-03-09 18:33:20.991: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:33:21.000: INFO @metrics_hook: train age_mae: 9.207 +-0.154 (13824) 2021-03-09 18:33:21.003: INFO @metrics_hook: train gender_accuracy: 0.875 +-0.006 (13824) 2021-03-09 18:33:24.009: INFO @decay_lr : LR updated to `0.00011691222` 2021-03-09 18:33:24.012: INFO @log_profile : T train: 22.163467 2021-03-09 18:33:24.012: INFO @log_profile : T read data: 0.592456 2021-03-09 18:33:24.012: INFO @log_profile : T hooks: 3.524811 2021-03-09 18:33:24.012: INFO @main_loop : Epoch 188 done 2021-03-09 18:33:24.012: INFO @main_loop : Training epoch 189 2021-03-09 18:33:44.687: INFO @log_variables: train loss nanmean: 1.268015 2021-03-09 18:33:44.687: INFO @log_variables: train age_loss mean: 9.539904 2021-03-09 18:33:44.687: INFO @log_variables: train gender_loss mean: 0.300192 2021-03-09 18:33:44.687: INFO @log_variables: train age_mae mean: 8.958645 2021-03-09 18:33:44.687: INFO @log_variables: train gender_accuracy mean: 0.871166 2021-03-09 18:33:44.687: INFO @log_variables: train gender_confidence/loss nanmean: 0.070841 2021-03-09 18:33:44.687: INFO @log_variables: train gender_confidence/accuracy mean: 0.768736 2021-03-09 18:33:44.687: INFO @log_variables: train age_confidence/loss mean: 0.057008 2021-03-09 18:33:44.687: INFO @log_variables: train age_confidence/accuracy mean: 0.672309 2021-03-09 18:33:44.687: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:33:44.689: INFO @metrics_hook: train age_mae: 8.959 +-0.151 (13824) 2021-03-09 18:33:44.691: INFO @metrics_hook: train gender_accuracy: 0.871 +-0.006 (13824) 2021-03-09 18:33:46.870: INFO @decay_lr : LR updated to `0.00011632766` 2021-03-09 18:33:46.871: INFO @log_profile : T train: 19.461419 2021-03-09 18:33:46.871: INFO @log_profile : T read data: 0.603662 2021-03-09 18:33:46.871: INFO @log_profile : T hooks: 2.739323 2021-03-09 18:33:46.871: INFO @main_loop : Epoch 189 done 2021-03-09 18:33:46.871: INFO @main_loop : Training epoch 190 2021-03-09 18:34:06.370: INFO @log_variables: train loss nanmean: 1.263677 2021-03-09 18:34:06.370: INFO @log_variables: train age_loss mean: 9.573025 2021-03-09 18:34:06.370: INFO @log_variables: train gender_loss mean: 0.293853 2021-03-09 18:34:06.370: INFO @log_variables: train age_mae mean: 8.990874 2021-03-09 18:34:06.371: INFO @log_variables: train gender_accuracy mean: 0.873770 2021-03-09 18:34:06.371: INFO @log_variables: train gender_confidence/loss nanmean: 0.069355 2021-03-09 18:34:06.371: INFO @log_variables: train gender_confidence/accuracy mean: 0.788701 2021-03-09 18:34:06.371: INFO @log_variables: train age_confidence/loss mean: 0.056908 2021-03-09 18:34:06.371: INFO @log_variables: train age_confidence/accuracy mean: 0.673828 2021-03-09 18:34:06.371: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:34:06.373: INFO @metrics_hook: train age_mae: 8.991 +-0.151 (13824) 2021-03-09 18:34:06.377: INFO @metrics_hook: train gender_accuracy: 0.874 +-0.006 (13824) 2021-03-09 18:34:09.143: INFO @decay_lr : LR updated to `0.00011574602` 2021-03-09 18:34:09.145: INFO @log_profile : T train: 18.606117 2021-03-09 18:34:09.145: INFO @log_profile : T read data: 0.351329 2021-03-09 18:34:09.145: INFO @log_profile : T hooks: 3.261846 2021-03-09 18:34:09.145: INFO @main_loop : Epoch 190 done 2021-03-09 18:34:09.145: INFO @main_loop : Training epoch 191 2021-03-09 18:34:28.443: INFO @log_variables: train loss nanmean: 1.250344 2021-03-09 18:34:28.443: INFO @log_variables: train age_loss mean: 9.426571 2021-03-09 18:34:28.443: INFO @log_variables: train gender_loss mean: 0.292135 2021-03-09 18:34:28.443: INFO @log_variables: train age_mae mean: 8.849876 2021-03-09 18:34:28.443: INFO @log_variables: train gender_accuracy mean: 0.875145 2021-03-09 18:34:28.443: INFO @log_variables: train gender_confidence/loss nanmean: 0.070146 2021-03-09 18:34:28.443: INFO @log_variables: train gender_confidence/accuracy mean: 0.775535 2021-03-09 18:34:28.443: INFO @log_variables: train age_confidence/loss mean: 0.057659 2021-03-09 18:34:28.443: INFO @log_variables: train age_confidence/accuracy mean: 0.669126 2021-03-09 18:34:28.443: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:34:28.445: INFO @metrics_hook: train age_mae: 8.850 +-0.149 (13824) 2021-03-09 18:34:28.447: INFO @metrics_hook: train gender_accuracy: 0.875 +-0.006 (13824) 2021-03-09 18:34:30.548: INFO @decay_lr : LR updated to `0.00011516729` 2021-03-09 18:34:30.550: INFO @log_profile : T train: 18.380450 2021-03-09 18:34:30.550: INFO @log_profile : T read data: 0.350533 2021-03-09 18:34:30.550: INFO @log_profile : T hooks: 2.622423 2021-03-09 18:34:30.550: INFO @main_loop : Epoch 191 done 2021-03-09 18:34:30.550: INFO @main_loop : Training epoch 192 2021-03-09 18:34:49.769: INFO @log_variables: train loss nanmean: 1.261233 2021-03-09 18:34:49.769: INFO @log_variables: train age_loss mean: 9.583879 2021-03-09 18:34:49.769: INFO @log_variables: train gender_loss mean: 0.289463 2021-03-09 18:34:49.769: INFO @log_variables: train age_mae mean: 9.001671 2021-03-09 18:34:49.769: INFO @log_variables: train gender_accuracy mean: 0.874855 2021-03-09 18:34:49.769: INFO @log_variables: train gender_confidence/loss nanmean: 0.069885 2021-03-09 18:34:49.770: INFO @log_variables: train gender_confidence/accuracy mean: 0.777488 2021-03-09 18:34:49.770: INFO @log_variables: train age_confidence/loss mean: 0.056938 2021-03-09 18:34:49.770: INFO @log_variables: train age_confidence/accuracy mean: 0.672092 2021-03-09 18:34:49.770: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:34:49.772: INFO @metrics_hook: train age_mae: 9.002 +-0.151 (13824) 2021-03-09 18:34:49.773: INFO @metrics_hook: train gender_accuracy: 0.875 +-0.006 (13824) 2021-03-09 18:34:51.821: INFO @decay_lr : LR updated to `0.00011459146` 2021-03-09 18:34:51.822: INFO @log_profile : T train: 18.212188 2021-03-09 18:34:51.822: INFO @log_profile : T read data: 0.449513 2021-03-09 18:34:51.822: INFO @log_profile : T hooks: 2.560697 2021-03-09 18:34:51.822: INFO @main_loop : Epoch 192 done 2021-03-09 18:34:51.822: INFO @main_loop : Training epoch 193 2021-03-09 18:35:10.959: INFO @log_variables: train loss nanmean: 1.278103 2021-03-09 18:35:10.960: INFO @log_variables: train age_loss mean: 9.726925 2021-03-09 18:35:10.960: INFO @log_variables: train gender_loss mean: 0.293393 2021-03-09 18:35:10.960: INFO @log_variables: train age_mae mean: 9.142833 2021-03-09 18:35:10.960: INFO @log_variables: train gender_accuracy mean: 0.874566 2021-03-09 18:35:10.960: INFO @log_variables: train gender_confidence/loss nanmean: 0.070541 2021-03-09 18:35:10.960: INFO @log_variables: train gender_confidence/accuracy mean: 0.771195 2021-03-09 18:35:10.960: INFO @log_variables: train age_confidence/loss mean: 0.056576 2021-03-09 18:35:10.960: INFO @log_variables: train age_confidence/accuracy mean: 0.673466 2021-03-09 18:35:10.960: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:35:10.963: INFO @metrics_hook: train age_mae: 9.143 +-0.154 (13824) 2021-03-09 18:35:10.966: INFO @metrics_hook: train gender_accuracy: 0.875 +-0.006 (13824) 2021-03-09 18:35:13.410: INFO @decay_lr : LR updated to `0.0001140185` 2021-03-09 18:35:13.411: INFO @log_profile : T train: 18.265126 2021-03-09 18:35:13.411: INFO @log_profile : T read data: 0.308347 2021-03-09 18:35:13.411: INFO @log_profile : T hooks: 2.966062 2021-03-09 18:35:13.411: INFO @main_loop : Epoch 193 done 2021-03-09 18:35:13.411: INFO @main_loop : Training epoch 194 2021-03-09 18:35:34.620: INFO @log_variables: train loss nanmean: 1.268842 2021-03-09 18:35:34.621: INFO @log_variables: train age_loss mean: 9.608024 2021-03-09 18:35:34.621: INFO @log_variables: train gender_loss mean: 0.294261 2021-03-09 18:35:34.621: INFO @log_variables: train age_mae mean: 9.027229 2021-03-09 18:35:34.621: INFO @log_variables: train gender_accuracy mean: 0.877025 2021-03-09 18:35:34.621: INFO @log_variables: train gender_confidence/loss nanmean: 0.071299 2021-03-09 18:35:34.621: INFO @log_variables: train gender_confidence/accuracy mean: 0.772352 2021-03-09 18:35:34.621: INFO @log_variables: train age_confidence/loss mean: 0.056577 2021-03-09 18:35:34.621: INFO @log_variables: train age_confidence/accuracy mean: 0.677807 2021-03-09 18:35:34.621: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:35:34.623: INFO @metrics_hook: train age_mae: 9.027 +-0.152 (13824) 2021-03-09 18:35:34.625: INFO @metrics_hook: train gender_accuracy: 0.877 +-0.006 (13824) 2021-03-09 18:35:37.583: INFO @decay_lr : LR updated to `0.000113448405` 2021-03-09 18:35:37.587: INFO @log_profile : T train: 20.204903 2021-03-09 18:35:37.587: INFO @log_profile : T read data: 0.451538 2021-03-09 18:35:37.587: INFO @log_profile : T hooks: 3.455916 2021-03-09 18:35:37.587: INFO @main_loop : Epoch 194 done 2021-03-09 18:35:37.587: INFO @main_loop : Training epoch 195 2021-03-09 18:35:59.544: INFO @log_variables: train loss nanmean: 1.283299 2021-03-09 18:35:59.544: INFO @log_variables: train age_loss mean: 9.705232 2021-03-09 18:35:59.544: INFO @log_variables: train gender_loss mean: 0.299778 2021-03-09 18:35:59.544: INFO @log_variables: train age_mae mean: 9.121389 2021-03-09 18:35:59.544: INFO @log_variables: train gender_accuracy mean: 0.872324 2021-03-09 18:35:59.544: INFO @log_variables: train gender_confidence/loss nanmean: 0.071873 2021-03-09 18:35:59.544: INFO @log_variables: train gender_confidence/accuracy mean: 0.767868 2021-03-09 18:35:59.545: INFO @log_variables: train age_confidence/loss mean: 0.056607 2021-03-09 18:35:59.545: INFO @log_variables: train age_confidence/accuracy mean: 0.677734 2021-03-09 18:35:59.545: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:35:59.547: INFO @metrics_hook: train age_mae: 9.121 +-0.152 (13824) 2021-03-09 18:35:59.550: INFO @metrics_hook: train gender_accuracy: 0.872 +-0.006 (13824) 2021-03-09 18:36:02.653: INFO @decay_lr : LR updated to `0.000112881164` 2021-03-09 18:36:02.657: INFO @log_profile : T train: 20.883602 2021-03-09 18:36:02.659: INFO @log_profile : T read data: 0.542959 2021-03-09 18:36:02.659: INFO @log_profile : T hooks: 3.589054 2021-03-09 18:36:02.659: INFO @main_loop : Epoch 195 done 2021-03-09 18:36:02.659: INFO @main_loop : Training epoch 196 2021-03-09 18:36:24.947: INFO @log_variables: train loss nanmean: 1.255134 2021-03-09 18:36:24.947: INFO @log_variables: train age_loss mean: 9.570850 2021-03-09 18:36:24.947: INFO @log_variables: train gender_loss mean: 0.284744 2021-03-09 18:36:24.947: INFO @log_variables: train age_mae mean: 8.993588 2021-03-09 18:36:24.947: INFO @log_variables: train gender_accuracy mean: 0.878834 2021-03-09 18:36:24.947: INFO @log_variables: train gender_confidence/loss nanmean: 0.069216 2021-03-09 18:36:24.947: INFO @log_variables: train gender_confidence/accuracy mean: 0.776114 2021-03-09 18:36:24.948: INFO @log_variables: train age_confidence/loss mean: 0.056982 2021-03-09 18:36:24.948: INFO @log_variables: train age_confidence/accuracy mean: 0.672526 2021-03-09 18:36:24.948: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:36:24.950: INFO @metrics_hook: train age_mae: 8.994 +-0.152 (13824) 2021-03-09 18:36:24.952: INFO @metrics_hook: train gender_accuracy: 0.879 +-0.006 (13824) 2021-03-09 18:36:27.534: INFO @decay_lr : LR updated to `0.00011231676` 2021-03-09 18:36:27.536: INFO @log_profile : T train: 20.920103 2021-03-09 18:36:27.536: INFO @log_profile : T read data: 0.804569 2021-03-09 18:36:27.536: INFO @log_profile : T hooks: 3.094226 2021-03-09 18:36:27.536: INFO @main_loop : Epoch 196 done 2021-03-09 18:36:27.536: INFO @main_loop : Training epoch 197 2021-03-09 18:36:49.034: INFO @log_variables: train loss nanmean: 1.256736 2021-03-09 18:36:49.034: INFO @log_variables: train age_loss mean: 9.531889 2021-03-09 18:36:49.035: INFO @log_variables: train gender_loss mean: 0.289815 2021-03-09 18:36:49.035: INFO @log_variables: train age_mae mean: 8.951225 2021-03-09 18:36:49.035: INFO @log_variables: train gender_accuracy mean: 0.875425 2021-03-09 18:36:49.035: INFO @log_variables: train gender_confidence/loss nanmean: 0.070226 2021-03-09 18:36:49.035: INFO @log_variables: train gender_confidence/accuracy mean: 0.778702 2021-03-09 18:36:49.035: INFO @log_variables: train age_confidence/loss mean: 0.056505 2021-03-09 18:36:49.035: INFO @log_variables: train age_confidence/accuracy mean: 0.682341 2021-03-09 18:36:49.035: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:36:49.037: INFO @metrics_hook: train age_mae: 8.951 +-0.151 (13823) 2021-03-09 18:36:49.039: INFO @metrics_hook: train gender_accuracy: 0.875 +-0.006 (13823) 2021-03-09 18:36:51.491: INFO @decay_lr : LR updated to `0.00011175518` 2021-03-09 18:36:51.492: INFO @log_profile : T train: 20.404198 2021-03-09 18:36:51.492: INFO @log_profile : T read data: 0.502008 2021-03-09 18:36:51.492: INFO @log_profile : T hooks: 2.987058 2021-03-09 18:36:51.492: INFO @main_loop : Epoch 197 done 2021-03-09 18:36:51.492: INFO @main_loop : Training epoch 198 2021-03-09 18:37:11.134: INFO @log_variables: train loss nanmean: 1.261890 2021-03-09 18:37:11.134: INFO @log_variables: train age_loss mean: 9.549994 2021-03-09 18:37:11.134: INFO @log_variables: train gender_loss mean: 0.290794 2021-03-09 18:37:11.134: INFO @log_variables: train age_mae mean: 8.967989 2021-03-09 18:37:11.134: INFO @log_variables: train gender_accuracy mean: 0.880489 2021-03-09 18:37:11.135: INFO @log_variables: train gender_confidence/loss nanmean: 0.071595 2021-03-09 18:37:11.135: INFO @log_variables: train gender_confidence/accuracy mean: 0.771178 2021-03-09 18:37:11.135: INFO @log_variables: train age_confidence/loss mean: 0.057756 2021-03-09 18:37:11.135: INFO @log_variables: train age_confidence/accuracy mean: 0.668379 2021-03-09 18:37:11.135: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:37:11.137: INFO @metrics_hook: train age_mae: 8.968 +-0.152 (13823) 2021-03-09 18:37:11.139: INFO @metrics_hook: train gender_accuracy: 0.880 +-0.006 (13823) 2021-03-09 18:37:13.434: INFO @decay_lr : LR updated to `0.0001111964` 2021-03-09 18:37:13.435: INFO @log_profile : T train: 18.711069 2021-03-09 18:37:13.435: INFO @log_profile : T read data: 0.361954 2021-03-09 18:37:13.435: INFO @log_profile : T hooks: 2.816883 2021-03-09 18:37:13.436: INFO @main_loop : Epoch 198 done 2021-03-09 18:37:13.436: INFO @main_loop : Training epoch 199 2021-03-09 18:37:32.854: INFO @log_variables: train loss nanmean: 1.263336 2021-03-09 18:37:32.854: INFO @log_variables: train age_loss mean: 9.488219 2021-03-09 18:37:32.854: INFO @log_variables: train gender_loss mean: 0.300448 2021-03-09 18:37:32.854: INFO @log_variables: train age_mae mean: 8.911121 2021-03-09 18:37:32.854: INFO @log_variables: train gender_accuracy mean: 0.870949 2021-03-09 18:37:32.854: INFO @log_variables: train gender_confidence/loss nanmean: 0.071028 2021-03-09 18:37:32.854: INFO @log_variables: train gender_confidence/accuracy mean: 0.773944 2021-03-09 18:37:32.854: INFO @log_variables: train age_confidence/loss mean: 0.056609 2021-03-09 18:37:32.854: INFO @log_variables: train age_confidence/accuracy mean: 0.676939 2021-03-09 18:37:32.855: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:37:32.857: INFO @metrics_hook: train age_mae: 8.911 +-0.150 (13824) 2021-03-09 18:37:32.860: INFO @metrics_hook: train gender_accuracy: 0.871 +-0.006 (13824) 2021-03-09 18:37:35.358: INFO @decay_lr : LR updated to `0.000110640416` 2021-03-09 18:37:35.359: INFO @log_profile : T train: 18.385667 2021-03-09 18:37:35.359: INFO @log_profile : T read data: 0.463328 2021-03-09 18:37:35.359: INFO @log_profile : T hooks: 3.021400 2021-03-09 18:37:35.359: INFO @main_loop : Epoch 199 done 2021-03-09 18:37:35.359: INFO @main_loop : Training epoch 200 2021-03-09 18:37:54.877: INFO @log_variables: train loss nanmean: 1.244665 2021-03-09 18:37:54.877: INFO @log_variables: train age_loss mean: 9.442781 2021-03-09 18:37:54.877: INFO @log_variables: train gender_loss mean: 0.284924 2021-03-09 18:37:54.878: INFO @log_variables: train age_mae mean: 8.865975 2021-03-09 18:37:54.878: INFO @log_variables: train gender_accuracy mean: 0.876736 2021-03-09 18:37:54.878: INFO @log_variables: train gender_confidence/loss nanmean: 0.069782 2021-03-09 18:37:54.878: INFO @log_variables: train gender_confidence/accuracy mean: 0.783854 2021-03-09 18:37:54.878: INFO @log_variables: train age_confidence/loss mean: 0.057426 2021-03-09 18:37:54.878: INFO @log_variables: train age_confidence/accuracy mean: 0.672237 2021-03-09 18:37:54.878: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:37:54.880: INFO @metrics_hook: train age_mae: 8.866 +-0.149 (13824) 2021-03-09 18:37:54.882: INFO @metrics_hook: train gender_accuracy: 0.877 +-0.006 (13824) 2021-03-09 18:37:57.066: INFO @decay_lr : LR updated to `0.00011008721` 2021-03-09 18:37:57.066: WARNING @module_wrapper: From /home/kopalja/.local/lib/python3.8/site-packages/emloop_tensorflow/model.py:304: The name tf.train.write_graph is deprecated. Please use tf.io.write_graph instead. 2021-03-09 18:37:57.499: INFO @save : Model saved to: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG/model_200.ckpt 2021-03-09 18:37:57.502: INFO @log_profile : T train: 18.600192 2021-03-09 18:37:57.502: INFO @log_profile : T read data: 0.356421 2021-03-09 18:37:57.503: INFO @log_profile : T hooks: 3.131299 2021-03-09 18:37:57.503: INFO @main_loop : Epoch 200 done 2021-03-09 18:37:57.503: INFO @main_loop : Training epoch 201 2021-03-09 18:38:17.014: INFO @log_variables: train loss nanmean: 1.255674 2021-03-09 18:38:17.014: INFO @log_variables: train age_loss mean: 9.456892 2021-03-09 18:38:17.014: INFO @log_variables: train gender_loss mean: 0.294403 2021-03-09 18:38:17.014: INFO @log_variables: train age_mae mean: 8.879362 2021-03-09 18:38:17.014: INFO @log_variables: train gender_accuracy mean: 0.875506 2021-03-09 18:38:17.014: INFO @log_variables: train gender_confidence/loss nanmean: 0.070420 2021-03-09 18:38:17.014: INFO @log_variables: train gender_confidence/accuracy mean: 0.768229 2021-03-09 18:38:17.015: INFO @log_variables: train age_confidence/loss mean: 0.057897 2021-03-09 18:38:17.015: INFO @log_variables: train age_confidence/accuracy mean: 0.667173 2021-03-09 18:38:17.015: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:38:17.017: INFO @metrics_hook: train age_mae: 8.879 +-0.152 (13824) 2021-03-09 18:38:17.018: INFO @metrics_hook: train gender_accuracy: 0.876 +-0.006 (13824) 2021-03-09 18:38:19.315: INFO @decay_lr : LR updated to `0.00010953678` 2021-03-09 18:38:19.319: INFO @log_profile : T train: 18.573399 2021-03-09 18:38:19.319: INFO @log_profile : T read data: 0.365063 2021-03-09 18:38:19.319: INFO @log_profile : T hooks: 2.825016 2021-03-09 18:38:19.319: INFO @main_loop : Epoch 201 done 2021-03-09 18:38:19.319: INFO @main_loop : Training epoch 202 2021-03-09 18:38:40.160: INFO @log_variables: train loss nanmean: 1.276715 2021-03-09 18:38:40.161: INFO @log_variables: train age_loss mean: 9.700913 2021-03-09 18:38:40.161: INFO @log_variables: train gender_loss mean: 0.296068 2021-03-09 18:38:40.161: INFO @log_variables: train age_mae mean: 9.116738 2021-03-09 18:38:40.161: INFO @log_variables: train gender_accuracy mean: 0.871817 2021-03-09 18:38:40.161: INFO @log_variables: train gender_confidence/loss nanmean: 0.069534 2021-03-09 18:38:40.163: INFO @log_variables: train gender_confidence/accuracy mean: 0.777271 2021-03-09 18:38:40.163: INFO @log_variables: train age_confidence/loss mean: 0.056128 2021-03-09 18:38:40.163: INFO @log_variables: train age_confidence/accuracy mean: 0.678024 2021-03-09 18:38:40.163: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:38:40.165: INFO @metrics_hook: train age_mae: 9.117 +-0.154 (13824) 2021-03-09 18:38:40.167: INFO @metrics_hook: train gender_accuracy: 0.872 +-0.006 (13824) 2021-03-09 18:38:42.996: INFO @decay_lr : LR updated to `0.000108989094` 2021-03-09 18:38:42.997: INFO @log_profile : T train: 19.628613 2021-03-09 18:38:42.997: INFO @log_profile : T read data: 0.665757 2021-03-09 18:38:42.998: INFO @log_profile : T hooks: 3.329504 2021-03-09 18:38:42.998: INFO @main_loop : Epoch 202 done 2021-03-09 18:38:42.998: INFO @main_loop : Training epoch 203 2021-03-09 18:39:02.981: INFO @log_variables: train loss nanmean: 1.246797 2021-03-09 18:39:02.982: INFO @log_variables: train age_loss mean: 9.372070 2021-03-09 18:39:02.982: INFO @log_variables: train gender_loss mean: 0.292560 2021-03-09 18:39:02.982: INFO @log_variables: train age_mae mean: 8.793952 2021-03-09 18:39:02.982: INFO @log_variables: train gender_accuracy mean: 0.876230 2021-03-09 18:39:02.982: INFO @log_variables: train gender_confidence/loss nanmean: 0.071067 2021-03-09 18:39:02.982: INFO @log_variables: train gender_confidence/accuracy mean: 0.773220 2021-03-09 18:39:02.982: INFO @log_variables: train age_confidence/loss mean: 0.057760 2021-03-09 18:39:02.982: INFO @log_variables: train age_confidence/accuracy mean: 0.664207 2021-03-09 18:39:02.982: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:39:02.984: INFO @metrics_hook: train age_mae: 8.794 +-0.150 (13824) 2021-03-09 18:39:02.988: INFO @metrics_hook: train gender_accuracy: 0.876 +-0.006 (13824) 2021-03-09 18:39:05.301: INFO @decay_lr : LR updated to `0.00010844415` 2021-03-09 18:39:05.303: INFO @log_profile : T train: 18.974303 2021-03-09 18:39:05.303: INFO @log_profile : T read data: 0.463596 2021-03-09 18:39:05.303: INFO @log_profile : T hooks: 2.812842 2021-03-09 18:39:05.303: INFO @main_loop : Epoch 203 done 2021-03-09 18:39:05.303: INFO @main_loop : Training epoch 204 2021-03-09 18:39:25.043: INFO @log_variables: train loss nanmean: 1.261843 2021-03-09 18:39:25.043: INFO @log_variables: train age_loss mean: 9.577378 2021-03-09 18:39:25.043: INFO @log_variables: train gender_loss mean: 0.289617 2021-03-09 18:39:25.044: INFO @log_variables: train age_mae mean: 8.997334 2021-03-09 18:39:25.044: INFO @log_variables: train gender_accuracy mean: 0.877966 2021-03-09 18:39:25.044: INFO @log_variables: train gender_confidence/loss nanmean: 0.071197 2021-03-09 18:39:25.044: INFO @log_variables: train gender_confidence/accuracy mean: 0.776620 2021-03-09 18:39:25.044: INFO @log_variables: train age_confidence/loss mean: 0.056688 2021-03-09 18:39:25.044: INFO @log_variables: train age_confidence/accuracy mean: 0.674045 2021-03-09 18:39:25.044: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:39:25.046: INFO @metrics_hook: train age_mae: 8.997 +-0.152 (13824) 2021-03-09 18:39:25.048: INFO @metrics_hook: train gender_accuracy: 0.878 +-0.006 (13824) 2021-03-09 18:39:27.412: INFO @decay_lr : LR updated to `0.00010790193` 2021-03-09 18:39:27.415: INFO @log_profile : T train: 18.839311 2021-03-09 18:39:27.415: INFO @log_profile : T read data: 0.354590 2021-03-09 18:39:27.415: INFO @log_profile : T hooks: 2.865425 2021-03-09 18:39:27.416: INFO @main_loop : Epoch 204 done 2021-03-09 18:39:27.416: INFO @main_loop : Training epoch 205 2021-03-09 18:39:47.004: INFO @log_variables: train loss nanmean: 1.254948 2021-03-09 18:39:47.004: INFO @log_variables: train age_loss mean: 9.472033 2021-03-09 18:39:47.004: INFO @log_variables: train gender_loss mean: 0.291587 2021-03-09 18:39:47.004: INFO @log_variables: train age_mae mean: 8.894295 2021-03-09 18:39:47.004: INFO @log_variables: train gender_accuracy mean: 0.876230 2021-03-09 18:39:47.004: INFO @log_variables: train gender_confidence/loss nanmean: 0.071303 2021-03-09 18:39:47.004: INFO @log_variables: train gender_confidence/accuracy mean: 0.773003 2021-03-09 18:39:47.004: INFO @log_variables: train age_confidence/loss mean: 0.057473 2021-03-09 18:39:47.004: INFO @log_variables: train age_confidence/accuracy mean: 0.669850 2021-03-09 18:39:47.004: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:39:47.006: INFO @metrics_hook: train age_mae: 8.894 +-0.151 (13824) 2021-03-09 18:39:47.008: INFO @metrics_hook: train gender_accuracy: 0.876 +-0.006 (13824) 2021-03-09 18:39:49.226: INFO @decay_lr : LR updated to `0.000107362415` 2021-03-09 18:39:49.228: INFO @log_profile : T train: 18.540387 2021-03-09 18:39:49.228: INFO @log_profile : T read data: 0.515809 2021-03-09 18:39:49.228: INFO @log_profile : T hooks: 2.706007 2021-03-09 18:39:49.228: INFO @main_loop : Epoch 205 done 2021-03-09 18:39:49.228: INFO @main_loop : Training epoch 206 2021-03-09 18:40:08.376: INFO @log_variables: train loss nanmean: 1.253294 2021-03-09 18:40:08.377: INFO @log_variables: train age_loss mean: 9.465642 2021-03-09 18:40:08.377: INFO @log_variables: train gender_loss mean: 0.290510 2021-03-09 18:40:08.377: INFO @log_variables: train age_mae mean: 8.887777 2021-03-09 18:40:08.377: INFO @log_variables: train gender_accuracy mean: 0.879404 2021-03-09 18:40:08.377: INFO @log_variables: train gender_confidence/loss nanmean: 0.071221 2021-03-09 18:40:08.377: INFO @log_variables: train gender_confidence/accuracy mean: 0.772698 2021-03-09 18:40:08.377: INFO @log_variables: train age_confidence/loss mean: 0.057459 2021-03-09 18:40:08.377: INFO @log_variables: train age_confidence/accuracy mean: 0.671562 2021-03-09 18:40:08.377: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:40:08.378: INFO @metrics_hook: train age_mae: 8.888 +-0.151 (13823) 2021-03-09 18:40:08.380: INFO @metrics_hook: train gender_accuracy: 0.879 +-0.006 (13823) 2021-03-09 18:40:10.428: INFO @decay_lr : LR updated to `0.0001068256` 2021-03-09 18:40:10.429: INFO @log_profile : T train: 18.269015 2021-03-09 18:40:10.429: INFO @log_profile : T read data: 0.323548 2021-03-09 18:40:10.429: INFO @log_profile : T hooks: 2.557236 2021-03-09 18:40:10.429: INFO @main_loop : Epoch 206 done 2021-03-09 18:40:10.429: INFO @main_loop : Training epoch 207 2021-03-09 18:40:29.357: INFO @log_variables: train loss nanmean: 1.251460 2021-03-09 18:40:29.357: INFO @log_variables: train age_loss mean: 9.485069 2021-03-09 18:40:29.357: INFO @log_variables: train gender_loss mean: 0.287697 2021-03-09 18:40:29.357: INFO @log_variables: train age_mae mean: 8.909126 2021-03-09 18:40:29.357: INFO @log_variables: train gender_accuracy mean: 0.876157 2021-03-09 18:40:29.357: INFO @log_variables: train gender_confidence/loss nanmean: 0.070361 2021-03-09 18:40:29.357: INFO @log_variables: train gender_confidence/accuracy mean: 0.780744 2021-03-09 18:40:29.358: INFO @log_variables: train age_confidence/loss mean: 0.057278 2021-03-09 18:40:29.358: INFO @log_variables: train age_confidence/accuracy mean: 0.669777 2021-03-09 18:40:29.358: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:40:29.360: INFO @metrics_hook: train age_mae: 8.909 +-0.151 (13824) 2021-03-09 18:40:29.362: INFO @metrics_hook: train gender_accuracy: 0.876 +-0.006 (13824) 2021-03-09 18:40:31.349: INFO @decay_lr : LR updated to `0.000106291474` 2021-03-09 18:40:31.352: INFO @log_profile : T train: 18.056784 2021-03-09 18:40:31.352: INFO @log_profile : T read data: 0.314156 2021-03-09 18:40:31.352: INFO @log_profile : T hooks: 2.502604 2021-03-09 18:40:31.352: INFO @main_loop : Epoch 207 done 2021-03-09 18:40:31.352: INFO @main_loop : Training epoch 208 2021-03-09 18:40:50.566: INFO @log_variables: train loss nanmean: 1.249913 2021-03-09 18:40:50.566: INFO @log_variables: train age_loss mean: 9.505249 2021-03-09 18:40:50.567: INFO @log_variables: train gender_loss mean: 0.285491 2021-03-09 18:40:50.567: INFO @log_variables: train age_mae mean: 8.928859 2021-03-09 18:40:50.567: INFO @log_variables: train gender_accuracy mean: 0.876447 2021-03-09 18:40:50.567: INFO @log_variables: train gender_confidence/loss nanmean: 0.068829 2021-03-09 18:40:50.567: INFO @log_variables: train gender_confidence/accuracy mean: 0.775969 2021-03-09 18:40:50.567: INFO @log_variables: train age_confidence/loss mean: 0.057433 2021-03-09 18:40:50.567: INFO @log_variables: train age_confidence/accuracy mean: 0.672237 2021-03-09 18:40:50.568: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:40:50.569: INFO @metrics_hook: train age_mae: 8.929 +-0.151 (13824) 2021-03-09 18:40:50.571: INFO @metrics_hook: train gender_accuracy: 0.876 +-0.006 (13824) 2021-03-09 18:40:52.617: INFO @decay_lr : LR updated to `0.00010576002` 2021-03-09 18:40:52.619: INFO @log_profile : T train: 18.226050 2021-03-09 18:40:52.619: INFO @log_profile : T read data: 0.436332 2021-03-09 18:40:52.619: INFO @log_profile : T hooks: 2.551662 2021-03-09 18:40:52.619: INFO @main_loop : Epoch 208 done 2021-03-09 18:40:52.619: INFO @main_loop : Training epoch 209 2021-03-09 18:41:11.928: INFO @log_variables: train loss nanmean: 1.243329 2021-03-09 18:41:11.928: INFO @log_variables: train age_loss mean: 9.363104 2021-03-09 18:41:11.928: INFO @log_variables: train gender_loss mean: 0.291923 2021-03-09 18:41:11.928: INFO @log_variables: train age_mae mean: 8.791341 2021-03-09 18:41:11.928: INFO @log_variables: train gender_accuracy mean: 0.875434 2021-03-09 18:41:11.928: INFO @log_variables: train gender_confidence/loss nanmean: 0.070267 2021-03-09 18:41:11.928: INFO @log_variables: train gender_confidence/accuracy mean: 0.775969 2021-03-09 18:41:11.928: INFO @log_variables: train age_confidence/loss mean: 0.056487 2021-03-09 18:41:11.928: INFO @log_variables: train age_confidence/accuracy mean: 0.681858 2021-03-09 18:41:11.928: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:41:11.930: INFO @metrics_hook: train age_mae: 8.791 +-0.147 (13824) 2021-03-09 18:41:11.932: INFO @metrics_hook: train gender_accuracy: 0.875 +-0.006 (13824) 2021-03-09 18:41:14.272: INFO @decay_lr : LR updated to `0.000105231215` 2021-03-09 18:41:14.274: INFO @log_profile : T train: 18.414093 2021-03-09 18:41:14.274: INFO @log_profile : T read data: 0.354241 2021-03-09 18:41:14.274: INFO @log_profile : T hooks: 2.835857 2021-03-09 18:41:14.275: INFO @main_loop : Epoch 209 done 2021-03-09 18:41:14.275: INFO @main_loop : Training epoch 210 2021-03-09 18:41:34.045: INFO @log_variables: train loss nanmean: 1.236195 2021-03-09 18:41:34.045: INFO @log_variables: train age_loss mean: 9.315538 2021-03-09 18:41:34.045: INFO @log_variables: train gender_loss mean: 0.287588 2021-03-09 18:41:34.045: INFO @log_variables: train age_mae mean: 8.740264 2021-03-09 18:41:34.045: INFO @log_variables: train gender_accuracy mean: 0.876447 2021-03-09 18:41:34.045: INFO @log_variables: train gender_confidence/loss nanmean: 0.069366 2021-03-09 18:41:34.045: INFO @log_variables: train gender_confidence/accuracy mean: 0.776982 2021-03-09 18:41:34.045: INFO @log_variables: train age_confidence/loss mean: 0.058519 2021-03-09 18:41:34.046: INFO @log_variables: train age_confidence/accuracy mean: 0.659650 2021-03-09 18:41:34.046: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:41:34.048: INFO @metrics_hook: train age_mae: 8.740 +-0.148 (13824) 2021-03-09 18:41:34.049: INFO @metrics_hook: train gender_accuracy: 0.876 +-0.006 (13824) 2021-03-09 18:41:37.033: INFO @decay_lr : LR updated to `0.00010470506` 2021-03-09 18:41:37.040: INFO @log_profile : T train: 18.872021 2021-03-09 18:41:37.040: INFO @log_profile : T read data: 0.360672 2021-03-09 18:41:37.040: INFO @log_profile : T hooks: 3.482049 2021-03-09 18:41:37.040: INFO @main_loop : Epoch 210 done 2021-03-09 18:41:37.040: INFO @main_loop : Training epoch 211 2021-03-09 18:41:58.995: INFO @log_variables: train loss nanmean: 1.244294 2021-03-09 18:41:58.996: INFO @log_variables: train age_loss mean: 9.467225 2021-03-09 18:41:58.996: INFO @log_variables: train gender_loss mean: 0.281366 2021-03-09 18:41:58.996: INFO @log_variables: train age_mae mean: 8.890023 2021-03-09 18:41:58.996: INFO @log_variables: train gender_accuracy mean: 0.881727 2021-03-09 18:41:58.996: INFO @log_variables: train gender_confidence/loss nanmean: 0.070475 2021-03-09 18:41:58.996: INFO @log_variables: train gender_confidence/accuracy mean: 0.773365 2021-03-09 18:41:58.996: INFO @log_variables: train age_confidence/loss mean: 0.057375 2021-03-09 18:41:58.996: INFO @log_variables: train age_confidence/accuracy mean: 0.673756 2021-03-09 18:41:58.996: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:41:58.998: INFO @metrics_hook: train age_mae: 8.890 +-0.151 (13824) 2021-03-09 18:41:59.000: INFO @metrics_hook: train gender_accuracy: 0.882 +-0.005 (13824) 2021-03-09 18:42:01.889: INFO @decay_lr : LR updated to `0.000104181534` 2021-03-09 18:42:01.890: INFO @log_profile : T train: 20.761923 2021-03-09 18:42:01.890: INFO @log_profile : T read data: 0.611514 2021-03-09 18:42:01.890: INFO @log_profile : T hooks: 3.413080 2021-03-09 18:42:01.891: INFO @main_loop : Epoch 211 done 2021-03-09 18:42:01.891: INFO @main_loop : Training epoch 212 2021-03-09 18:42:23.489: INFO @log_variables: train loss nanmean: 1.255553 2021-03-09 18:42:23.490: INFO @log_variables: train age_loss mean: 9.556365 2021-03-09 18:42:23.490: INFO @log_variables: train gender_loss mean: 0.287102 2021-03-09 18:42:23.490: INFO @log_variables: train age_mae mean: 8.975828 2021-03-09 18:42:23.490: INFO @log_variables: train gender_accuracy mean: 0.874421 2021-03-09 18:42:23.490: INFO @log_variables: train gender_confidence/loss nanmean: 0.068960 2021-03-09 18:42:23.490: INFO @log_variables: train gender_confidence/accuracy mean: 0.781829 2021-03-09 18:42:23.490: INFO @log_variables: train age_confidence/loss mean: 0.056831 2021-03-09 18:42:23.490: INFO @log_variables: train age_confidence/accuracy mean: 0.676577 2021-03-09 18:42:23.490: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:42:23.492: INFO @metrics_hook: train age_mae: 8.976 +-0.153 (13824) 2021-03-09 18:42:23.494: INFO @metrics_hook: train gender_accuracy: 0.874 +-0.006 (13824) 2021-03-09 18:42:26.521: INFO @decay_lr : LR updated to `0.000103660626` 2021-03-09 18:42:26.527: INFO @log_profile : T train: 20.424088 2021-03-09 18:42:26.529: INFO @log_profile : T read data: 0.628497 2021-03-09 18:42:26.531: INFO @log_profile : T hooks: 3.528303 2021-03-09 18:42:26.532: INFO @main_loop : Epoch 212 done 2021-03-09 18:42:26.534: INFO @main_loop : Training epoch 213 2021-03-09 18:42:48.067: INFO @log_variables: train loss nanmean: 1.228843 2021-03-09 18:42:48.068: INFO @log_variables: train age_loss mean: 9.327976 2021-03-09 18:42:48.068: INFO @log_variables: train gender_loss mean: 0.277646 2021-03-09 18:42:48.068: INFO @log_variables: train age_mae mean: 8.753868 2021-03-09 18:42:48.069: INFO @log_variables: train gender_accuracy mean: 0.884766 2021-03-09 18:42:48.069: INFO @log_variables: train gender_confidence/loss nanmean: 0.070795 2021-03-09 18:42:48.069: INFO @log_variables: train gender_confidence/accuracy mean: 0.774667 2021-03-09 18:42:48.069: INFO @log_variables: train age_confidence/loss mean: 0.057645 2021-03-09 18:42:48.069: INFO @log_variables: train age_confidence/accuracy mean: 0.671296 2021-03-09 18:42:48.069: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:42:48.071: INFO @metrics_hook: train age_mae: 8.754 +-0.148 (13824) 2021-03-09 18:42:48.073: INFO @metrics_hook: train gender_accuracy: 0.885 +-0.005 (13824) 2021-03-09 18:42:51.008: INFO @decay_lr : LR updated to `0.00010314232` 2021-03-09 18:42:51.014: INFO @log_profile : T train: 20.437626 2021-03-09 18:42:51.015: INFO @log_profile : T read data: 0.511218 2021-03-09 18:42:51.015: INFO @log_profile : T hooks: 3.468955 2021-03-09 18:42:51.015: INFO @main_loop : Epoch 213 done 2021-03-09 18:42:51.015: INFO @main_loop : Training epoch 214 2021-03-09 18:43:11.567: INFO @log_variables: train loss nanmean: 1.240828 2021-03-09 18:43:11.567: INFO @log_variables: train age_loss mean: 9.374974 2021-03-09 18:43:11.567: INFO @log_variables: train gender_loss mean: 0.285071 2021-03-09 18:43:11.567: INFO @log_variables: train age_mae mean: 8.800900 2021-03-09 18:43:11.567: INFO @log_variables: train gender_accuracy mean: 0.881076 2021-03-09 18:43:11.567: INFO @log_variables: train gender_confidence/loss nanmean: 0.071844 2021-03-09 18:43:11.568: INFO @log_variables: train gender_confidence/accuracy mean: 0.772208 2021-03-09 18:43:11.568: INFO @log_variables: train age_confidence/loss mean: 0.057559 2021-03-09 18:43:11.568: INFO @log_variables: train age_confidence/accuracy mean: 0.666377 2021-03-09 18:43:11.568: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:43:11.570: INFO @metrics_hook: train age_mae: 8.801 +-0.149 (13824) 2021-03-09 18:43:11.573: INFO @metrics_hook: train gender_accuracy: 0.881 +-0.006 (13824) 2021-03-09 18:43:13.994: INFO @decay_lr : LR updated to `0.00010262661` 2021-03-09 18:43:13.996: INFO @log_profile : T train: 19.531835 2021-03-09 18:43:13.996: INFO @log_profile : T read data: 0.444588 2021-03-09 18:43:13.996: INFO @log_profile : T hooks: 2.940758 2021-03-09 18:43:13.996: INFO @main_loop : Epoch 214 done 2021-03-09 18:43:13.996: INFO @main_loop : Training epoch 215 2021-03-09 18:43:32.847: INFO @log_variables: train loss nanmean: 1.240012 2021-03-09 18:43:32.847: INFO @log_variables: train age_loss mean: 9.348793 2021-03-09 18:43:32.847: INFO @log_variables: train gender_loss mean: 0.287817 2021-03-09 18:43:32.847: INFO @log_variables: train age_mae mean: 8.775502 2021-03-09 18:43:32.847: INFO @log_variables: train gender_accuracy mean: 0.878689 2021-03-09 18:43:32.847: INFO @log_variables: train gender_confidence/loss nanmean: 0.070703 2021-03-09 18:43:32.847: INFO @log_variables: train gender_confidence/accuracy mean: 0.773655 2021-03-09 18:43:32.847: INFO @log_variables: train age_confidence/loss mean: 0.057766 2021-03-09 18:43:32.847: INFO @log_variables: train age_confidence/accuracy mean: 0.670862 2021-03-09 18:43:32.847: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:43:32.849: INFO @metrics_hook: train age_mae: 8.776 +-0.149 (13824) 2021-03-09 18:43:32.850: INFO @metrics_hook: train gender_accuracy: 0.879 +-0.006 (13824) 2021-03-09 18:43:35.139: INFO @decay_lr : LR updated to `0.00010211348` 2021-03-09 18:43:35.141: INFO @log_profile : T train: 17.820857 2021-03-09 18:43:35.141: INFO @log_profile : T read data: 0.470515 2021-03-09 18:43:35.141: INFO @log_profile : T hooks: 2.800062 2021-03-09 18:43:35.141: INFO @main_loop : Epoch 215 done 2021-03-09 18:43:35.141: INFO @main_loop : Training epoch 216 2021-03-09 18:43:53.618: INFO @log_variables: train loss nanmean: 1.236767 2021-03-09 18:43:53.618: INFO @log_variables: train age_loss mean: 9.356006 2021-03-09 18:43:53.618: INFO @log_variables: train gender_loss mean: 0.285300 2021-03-09 18:43:53.618: INFO @log_variables: train age_mae mean: 8.781434 2021-03-09 18:43:53.618: INFO @log_variables: train gender_accuracy mean: 0.878834 2021-03-09 18:43:53.618: INFO @log_variables: train gender_confidence/loss nanmean: 0.069437 2021-03-09 18:43:53.618: INFO @log_variables: train gender_confidence/accuracy mean: 0.779876 2021-03-09 18:43:53.619: INFO @log_variables: train age_confidence/loss mean: 0.057420 2021-03-09 18:43:53.619: INFO @log_variables: train age_confidence/accuracy mean: 0.672237 2021-03-09 18:43:53.619: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:43:53.620: INFO @metrics_hook: train age_mae: 8.781 +-0.151 (13824) 2021-03-09 18:43:53.622: INFO @metrics_hook: train gender_accuracy: 0.879 +-0.006 (13824) 2021-03-09 18:43:56.196: INFO @decay_lr : LR updated to `0.00010160291` 2021-03-09 18:43:56.197: INFO @log_profile : T train: 17.561088 2021-03-09 18:43:56.197: INFO @log_profile : T read data: 0.375538 2021-03-09 18:43:56.197: INFO @log_profile : T hooks: 3.065046 2021-03-09 18:43:56.198: INFO @main_loop : Epoch 216 done 2021-03-09 18:43:56.198: INFO @main_loop : Training epoch 217 2021-03-09 18:44:15.027: INFO @log_variables: train loss nanmean: 1.234566 2021-03-09 18:44:15.027: INFO @log_variables: train age_loss mean: 9.328180 2021-03-09 18:44:15.027: INFO @log_variables: train gender_loss mean: 0.284632 2021-03-09 18:44:15.027: INFO @log_variables: train age_mae mean: 8.754645 2021-03-09 18:44:15.027: INFO @log_variables: train gender_accuracy mean: 0.880498 2021-03-09 18:44:15.027: INFO @log_variables: train gender_confidence/loss nanmean: 0.070127 2021-03-09 18:44:15.027: INFO @log_variables: train gender_confidence/accuracy mean: 0.777561 2021-03-09 18:44:15.027: INFO @log_variables: train age_confidence/loss mean: 0.057666 2021-03-09 18:44:15.028: INFO @log_variables: train age_confidence/accuracy mean: 0.666450 2021-03-09 18:44:15.028: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:44:15.029: INFO @metrics_hook: train age_mae: 8.755 +-0.148 (13824) 2021-03-09 18:44:15.031: INFO @metrics_hook: train gender_accuracy: 0.880 +-0.006 (13824) 2021-03-09 18:44:17.544: INFO @decay_lr : LR updated to `0.0001010949` 2021-03-09 18:44:17.546: INFO @log_profile : T train: 17.899748 2021-03-09 18:44:17.546: INFO @log_profile : T read data: 0.367346 2021-03-09 18:44:17.546: INFO @log_profile : T hooks: 3.024640 2021-03-09 18:44:17.546: INFO @main_loop : Epoch 217 done 2021-03-09 18:44:17.546: INFO @main_loop : Training epoch 218 2021-03-09 18:44:36.244: INFO @log_variables: train loss nanmean: 1.238522 2021-03-09 18:44:36.244: INFO @log_variables: train age_loss mean: 9.367181 2021-03-09 18:44:36.244: INFO @log_variables: train gender_loss mean: 0.284192 2021-03-09 18:44:36.244: INFO @log_variables: train age_mae mean: 8.795630 2021-03-09 18:44:36.244: INFO @log_variables: train gender_accuracy mean: 0.882595 2021-03-09 18:44:36.244: INFO @log_variables: train gender_confidence/loss nanmean: 0.071913 2021-03-09 18:44:36.245: INFO @log_variables: train gender_confidence/accuracy mean: 0.770761 2021-03-09 18:44:36.245: INFO @log_variables: train age_confidence/loss mean: 0.056691 2021-03-09 18:44:36.245: INFO @log_variables: train age_confidence/accuracy mean: 0.680845 2021-03-09 18:44:36.245: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:44:36.248: INFO @metrics_hook: train age_mae: 8.796 +-0.148 (13824) 2021-03-09 18:44:36.250: INFO @metrics_hook: train gender_accuracy: 0.883 +-0.005 (13824) 2021-03-09 18:44:38.473: INFO @decay_lr : LR updated to `0.00010058942` 2021-03-09 18:44:38.475: INFO @log_profile : T train: 17.676491 2021-03-09 18:44:38.476: INFO @log_profile : T read data: 0.458067 2021-03-09 18:44:38.476: INFO @log_profile : T hooks: 2.741152 2021-03-09 18:44:38.476: INFO @main_loop : Epoch 218 done 2021-03-09 18:44:38.476: INFO @main_loop : Training epoch 219 2021-03-09 18:44:58.122: INFO @log_variables: train loss nanmean: 1.222808 2021-03-09 18:44:58.124: INFO @log_variables: train age_loss mean: 9.328818 2021-03-09 18:44:58.125: INFO @log_variables: train gender_loss mean: 0.273669 2021-03-09 18:44:58.125: INFO @log_variables: train age_mae mean: 8.759488 2021-03-09 18:44:58.125: INFO @log_variables: train gender_accuracy mean: 0.882957 2021-03-09 18:44:58.125: INFO @log_variables: train gender_confidence/loss nanmean: 0.069406 2021-03-09 18:44:58.125: INFO @log_variables: train gender_confidence/accuracy mean: 0.781829 2021-03-09 18:44:58.126: INFO @log_variables: train age_confidence/loss mean: 0.056537 2021-03-09 18:44:58.126: INFO @log_variables: train age_confidence/accuracy mean: 0.677590 2021-03-09 18:44:58.126: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:44:58.128: INFO @metrics_hook: train age_mae: 8.759 +-0.148 (13824) 2021-03-09 18:44:58.130: INFO @metrics_hook: train gender_accuracy: 0.883 +-0.005 (13824) 2021-03-09 18:45:01.119: INFO @decay_lr : LR updated to `0.00010008647` 2021-03-09 18:45:01.125: INFO @log_profile : T train: 18.669355 2021-03-09 18:45:01.125: INFO @log_profile : T read data: 0.420131 2021-03-09 18:45:01.125: INFO @log_profile : T hooks: 3.502871 2021-03-09 18:45:01.125: INFO @main_loop : Epoch 219 done 2021-03-09 18:45:01.125: INFO @main_loop : Training epoch 220 2021-03-09 18:45:19.914: INFO @log_variables: train loss nanmean: 1.222895 2021-03-09 18:45:19.915: INFO @log_variables: train age_loss mean: 9.301159 2021-03-09 18:45:19.915: INFO @log_variables: train gender_loss mean: 0.276930 2021-03-09 18:45:19.915: INFO @log_variables: train age_mae mean: 8.729491 2021-03-09 18:45:19.915: INFO @log_variables: train gender_accuracy mean: 0.880498 2021-03-09 18:45:19.915: INFO @log_variables: train gender_confidence/loss nanmean: 0.067851 2021-03-09 18:45:19.915: INFO @log_variables: train gender_confidence/accuracy mean: 0.787905 2021-03-09 18:45:19.915: INFO @log_variables: train age_confidence/loss mean: 0.057729 2021-03-09 18:45:19.915: INFO @log_variables: train age_confidence/accuracy mean: 0.672092 2021-03-09 18:45:19.915: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:45:19.916: INFO @metrics_hook: train age_mae: 8.729 +-0.151 (13824) 2021-03-09 18:45:19.918: INFO @metrics_hook: train gender_accuracy: 0.880 +-0.006 (13824) 2021-03-09 18:45:22.436: INFO @decay_lr : LR updated to `9.958604e-05` 2021-03-09 18:45:22.438: INFO @log_profile : T train: 17.851716 2021-03-09 18:45:22.438: INFO @log_profile : T read data: 0.401870 2021-03-09 18:45:22.438: INFO @log_profile : T hooks: 3.002818 2021-03-09 18:45:22.438: INFO @main_loop : Epoch 220 done 2021-03-09 18:45:22.438: INFO @main_loop : Training epoch 221 2021-03-09 18:45:41.350: INFO @log_variables: train loss nanmean: 1.239357 2021-03-09 18:45:41.351: INFO @log_variables: train age_loss mean: 9.356659 2021-03-09 18:45:41.351: INFO @log_variables: train gender_loss mean: 0.287571 2021-03-09 18:45:41.351: INFO @log_variables: train age_mae mean: 8.782554 2021-03-09 18:45:41.351: INFO @log_variables: train gender_accuracy mean: 0.878545 2021-03-09 18:45:41.351: INFO @log_variables: train gender_confidence/loss nanmean: 0.069907 2021-03-09 18:45:41.351: INFO @log_variables: train gender_confidence/accuracy mean: 0.778718 2021-03-09 18:45:41.351: INFO @log_variables: train age_confidence/loss mean: 0.057417 2021-03-09 18:45:41.351: INFO @log_variables: train age_confidence/accuracy mean: 0.669054 2021-03-09 18:45:41.351: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:45:41.353: INFO @metrics_hook: train age_mae: 8.783 +-0.149 (13824) 2021-03-09 18:45:41.356: INFO @metrics_hook: train gender_accuracy: 0.879 +-0.006 (13824) 2021-03-09 18:45:44.550: INFO @decay_lr : LR updated to `9.908811e-05` 2021-03-09 18:45:44.552: INFO @log_profile : T train: 17.864403 2021-03-09 18:45:44.552: INFO @log_profile : T read data: 0.502075 2021-03-09 18:45:44.554: INFO @log_profile : T hooks: 3.688657 2021-03-09 18:45:44.555: INFO @main_loop : Epoch 221 done 2021-03-09 18:45:44.557: INFO @main_loop : Training epoch 222 2021-03-09 18:46:06.723: INFO @log_variables: train loss nanmean: 1.239971 2021-03-09 18:46:06.723: INFO @log_variables: train age_loss mean: 9.373739 2021-03-09 18:46:06.723: INFO @log_variables: train gender_loss mean: 0.285212 2021-03-09 18:46:06.723: INFO @log_variables: train age_mae mean: 8.800670 2021-03-09 18:46:06.723: INFO @log_variables: train gender_accuracy mean: 0.880715 2021-03-09 18:46:06.723: INFO @log_variables: train gender_confidence/loss nanmean: 0.070341 2021-03-09 18:46:06.723: INFO @log_variables: train gender_confidence/accuracy mean: 0.778646 2021-03-09 18:46:06.723: INFO @log_variables: train age_confidence/loss mean: 0.058188 2021-03-09 18:46:06.723: INFO @log_variables: train age_confidence/accuracy mean: 0.666811 2021-03-09 18:46:06.723: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:46:06.727: INFO @metrics_hook: train age_mae: 8.801 +-0.152 (13824) 2021-03-09 18:46:06.729: INFO @metrics_hook: train gender_accuracy: 0.881 +-0.006 (13824) 2021-03-09 18:46:12.912: INFO @decay_lr : LR updated to `9.859267e-05` 2021-03-09 18:46:12.914: INFO @log_profile : T train: 21.075133 2021-03-09 18:46:12.914: INFO @log_profile : T read data: 0.543004 2021-03-09 18:46:12.914: INFO @log_profile : T hooks: 6.680268 2021-03-09 18:46:12.914: INFO @main_loop : Epoch 222 done 2021-03-09 18:46:12.914: INFO @main_loop : Training epoch 223 2021-03-09 18:46:31.589: INFO @log_variables: train loss nanmean: 1.228960 2021-03-09 18:46:31.589: INFO @log_variables: train age_loss mean: 9.259698 2021-03-09 18:46:31.589: INFO @log_variables: train gender_loss mean: 0.285476 2021-03-09 18:46:31.590: INFO @log_variables: train age_mae mean: 8.687779 2021-03-09 18:46:31.590: INFO @log_variables: train gender_accuracy mean: 0.879919 2021-03-09 18:46:31.590: INFO @log_variables: train gender_confidence/loss nanmean: 0.069757 2021-03-09 18:46:31.590: INFO @log_variables: train gender_confidence/accuracy mean: 0.780527 2021-03-09 18:46:31.590: INFO @log_variables: train age_confidence/loss mean: 0.057888 2021-03-09 18:46:31.590: INFO @log_variables: train age_confidence/accuracy mean: 0.669488 2021-03-09 18:46:31.590: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:46:31.593: INFO @metrics_hook: train age_mae: 8.688 +-0.147 (13824) 2021-03-09 18:46:31.597: INFO @metrics_hook: train gender_accuracy: 0.880 +-0.006 (13824) 2021-03-09 18:46:33.840: INFO @decay_lr : LR updated to `9.809971e-05` 2021-03-09 18:46:33.841: INFO @log_profile : T train: 17.762243 2021-03-09 18:46:33.841: INFO @log_profile : T read data: 0.368190 2021-03-09 18:46:33.841: INFO @log_profile : T hooks: 2.744182 2021-03-09 18:46:33.841: INFO @main_loop : Epoch 223 done 2021-03-09 18:46:33.842: INFO @main_loop : Training epoch 224 2021-03-09 18:46:52.738: INFO @log_variables: train loss nanmean: 1.219264 2021-03-09 18:46:52.738: INFO @log_variables: train age_loss mean: 9.301820 2021-03-09 18:46:52.739: INFO @log_variables: train gender_loss mean: 0.273601 2021-03-09 18:46:52.739: INFO @log_variables: train age_mae mean: 8.733254 2021-03-09 18:46:52.739: INFO @log_variables: train gender_accuracy mean: 0.883247 2021-03-09 18:46:52.739: INFO @log_variables: train gender_confidence/loss nanmean: 0.067353 2021-03-09 18:46:52.739: INFO @log_variables: train gender_confidence/accuracy mean: 0.788773 2021-03-09 18:46:52.739: INFO @log_variables: train age_confidence/loss mean: 0.057563 2021-03-09 18:46:52.739: INFO @log_variables: train age_confidence/accuracy mean: 0.673683 2021-03-09 18:46:52.739: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:46:52.741: INFO @metrics_hook: train age_mae: 8.733 +-0.148 (13824) 2021-03-09 18:46:52.743: INFO @metrics_hook: train gender_accuracy: 0.883 +-0.005 (13824) 2021-03-09 18:46:55.468: INFO @decay_lr : LR updated to `9.7609205e-05` 2021-03-09 18:46:55.471: INFO @log_profile : T train: 17.818527 2021-03-09 18:46:55.471: INFO @log_profile : T read data: 0.535173 2021-03-09 18:46:55.471: INFO @log_profile : T hooks: 3.222376 2021-03-09 18:46:55.471: INFO @main_loop : Epoch 224 done 2021-03-09 18:46:55.471: INFO @main_loop : Training epoch 225 2021-03-09 18:47:14.329: INFO @log_variables: train loss nanmean: 1.225589 2021-03-09 18:47:14.329: INFO @log_variables: train age_loss mean: 9.257122 2021-03-09 18:47:14.329: INFO @log_variables: train gender_loss mean: 0.282389 2021-03-09 18:47:14.329: INFO @log_variables: train age_mae mean: 8.686690 2021-03-09 18:47:14.329: INFO @log_variables: train gender_accuracy mean: 0.880570 2021-03-09 18:47:14.329: INFO @log_variables: train gender_confidence/loss nanmean: 0.069413 2021-03-09 18:47:14.330: INFO @log_variables: train gender_confidence/accuracy mean: 0.781539 2021-03-09 18:47:14.330: INFO @log_variables: train age_confidence/loss mean: 0.057902 2021-03-09 18:47:14.330: INFO @log_variables: train age_confidence/accuracy mean: 0.666956 2021-03-09 18:47:14.330: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:47:14.332: INFO @metrics_hook: train age_mae: 8.687 +-0.148 (13824) 2021-03-09 18:47:14.333: INFO @metrics_hook: train gender_accuracy: 0.881 +-0.006 (13824) 2021-03-09 18:47:16.684: INFO @decay_lr : LR updated to `9.7121156e-05` 2021-03-09 18:47:16.688: INFO @log_profile : T train: 17.918793 2021-03-09 18:47:16.688: INFO @log_profile : T read data: 0.388840 2021-03-09 18:47:16.688: INFO @log_profile : T hooks: 2.856231 2021-03-09 18:47:16.688: INFO @main_loop : Epoch 225 done 2021-03-09 18:47:16.688: INFO @main_loop : Training epoch 226 2021-03-09 18:47:35.476: INFO @log_variables: train loss nanmean: 1.233274 2021-03-09 18:47:35.476: INFO @log_variables: train age_loss mean: 9.350745 2021-03-09 18:47:35.476: INFO @log_variables: train gender_loss mean: 0.282141 2021-03-09 18:47:35.476: INFO @log_variables: train age_mae mean: 8.772907 2021-03-09 18:47:35.476: INFO @log_variables: train gender_accuracy mean: 0.882017 2021-03-09 18:47:35.476: INFO @log_variables: train gender_confidence/loss nanmean: 0.069493 2021-03-09 18:47:35.476: INFO @log_variables: train gender_confidence/accuracy mean: 0.782118 2021-03-09 18:47:35.476: INFO @log_variables: train age_confidence/loss mean: 0.057222 2021-03-09 18:47:35.476: INFO @log_variables: train age_confidence/accuracy mean: 0.673539 2021-03-09 18:47:35.476: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:47:35.478: INFO @metrics_hook: train age_mae: 8.773 +-0.150 (13824) 2021-03-09 18:47:35.480: INFO @metrics_hook: train gender_accuracy: 0.882 +-0.005 (13824) 2021-03-09 18:47:37.746: INFO @decay_lr : LR updated to `9.663555e-05` 2021-03-09 18:47:37.748: INFO @log_profile : T train: 17.893162 2021-03-09 18:47:37.748: INFO @log_profile : T read data: 0.362697 2021-03-09 18:47:37.748: INFO @log_profile : T hooks: 2.752039 2021-03-09 18:47:37.748: INFO @main_loop : Epoch 226 done 2021-03-09 18:47:37.748: INFO @main_loop : Training epoch 227 2021-03-09 18:47:56.394: INFO @log_variables: train loss nanmean: 1.217595 2021-03-09 18:47:56.394: INFO @log_variables: train age_loss mean: 9.199731 2021-03-09 18:47:56.394: INFO @log_variables: train gender_loss mean: 0.278304 2021-03-09 18:47:56.394: INFO @log_variables: train age_mae mean: 8.629724 2021-03-09 18:47:56.394: INFO @log_variables: train gender_accuracy mean: 0.882668 2021-03-09 18:47:56.394: INFO @log_variables: train gender_confidence/loss nanmean: 0.069987 2021-03-09 18:47:56.394: INFO @log_variables: train gender_confidence/accuracy mean: 0.779297 2021-03-09 18:47:56.395: INFO @log_variables: train age_confidence/loss mean: 0.058265 2021-03-09 18:47:56.395: INFO @log_variables: train age_confidence/accuracy mean: 0.670573 2021-03-09 18:47:56.395: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:47:56.397: INFO @metrics_hook: train age_mae: 8.630 +-0.149 (13824) 2021-03-09 18:47:56.399: INFO @metrics_hook: train gender_accuracy: 0.883 +-0.005 (13824) 2021-03-09 18:47:58.789: INFO @decay_lr : LR updated to `9.615238e-05` 2021-03-09 18:47:58.790: INFO @log_profile : T train: 17.750341 2021-03-09 18:47:58.790: INFO @log_profile : T read data: 0.347455 2021-03-09 18:47:58.790: INFO @log_profile : T hooks: 2.892145 2021-03-09 18:47:58.790: INFO @main_loop : Epoch 227 done 2021-03-09 18:47:58.790: INFO @main_loop : Training epoch 228 2021-03-09 18:48:20.550: INFO @log_variables: train loss nanmean: 1.204952 2021-03-09 18:48:20.553: INFO @log_variables: train age_loss mean: 9.129542 2021-03-09 18:48:20.554: INFO @log_variables: train gender_loss mean: 0.272511 2021-03-09 18:48:20.556: INFO @log_variables: train age_mae mean: 8.563625 2021-03-09 18:48:20.558: INFO @log_variables: train gender_accuracy mean: 0.885706 2021-03-09 18:48:20.560: INFO @log_variables: train gender_confidence/loss nanmean: 0.069250 2021-03-09 18:48:20.560: INFO @log_variables: train gender_confidence/accuracy mean: 0.784071 2021-03-09 18:48:20.562: INFO @log_variables: train age_confidence/loss mean: 0.058006 2021-03-09 18:48:20.562: INFO @log_variables: train age_confidence/accuracy mean: 0.668258 2021-03-09 18:48:20.563: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:48:20.567: INFO @metrics_hook: train age_mae: 8.564 +-0.148 (13824) 2021-03-09 18:48:20.571: INFO @metrics_hook: train gender_accuracy: 0.886 +-0.005 (13824) 2021-03-09 18:48:23.505: INFO @decay_lr : LR updated to `9.567162e-05` 2021-03-09 18:48:23.508: INFO @log_profile : T train: 20.597268 2021-03-09 18:48:23.509: INFO @log_profile : T read data: 0.593958 2021-03-09 18:48:23.509: INFO @log_profile : T hooks: 3.469489 2021-03-09 18:48:23.509: INFO @main_loop : Epoch 228 done 2021-03-09 18:48:23.509: INFO @main_loop : Training epoch 229 2021-03-09 18:48:45.725: INFO @log_variables: train loss nanmean: 1.226136 2021-03-09 18:48:45.727: INFO @log_variables: train age_loss mean: 9.248734 2021-03-09 18:48:45.730: INFO @log_variables: train gender_loss mean: 0.283281 2021-03-09 18:48:45.731: INFO @log_variables: train age_mae mean: 8.674620 2021-03-09 18:48:45.733: INFO @log_variables: train gender_accuracy mean: 0.879413 2021-03-09 18:48:45.735: INFO @log_variables: train gender_confidence/loss nanmean: 0.069450 2021-03-09 18:48:45.737: INFO @log_variables: train gender_confidence/accuracy mean: 0.782046 2021-03-09 18:48:45.737: INFO @log_variables: train age_confidence/loss mean: 0.058363 2021-03-09 18:48:45.737: INFO @log_variables: train age_confidence/accuracy mean: 0.662182 2021-03-09 18:48:45.737: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:48:45.739: INFO @metrics_hook: train age_mae: 8.675 +-0.151 (13824) 2021-03-09 18:48:45.741: INFO @metrics_hook: train gender_accuracy: 0.879 +-0.006 (13824) 2021-03-09 18:48:48.648: INFO @decay_lr : LR updated to `9.519326e-05` 2021-03-09 18:48:48.651: INFO @log_profile : T train: 21.130167 2021-03-09 18:48:48.652: INFO @log_profile : T read data: 0.526194 2021-03-09 18:48:48.652: INFO @log_profile : T hooks: 3.427879 2021-03-09 18:48:48.652: INFO @main_loop : Epoch 229 done 2021-03-09 18:48:48.652: INFO @main_loop : Training epoch 230 2021-03-09 18:49:09.202: INFO @log_variables: train loss nanmean: 1.226942 2021-03-09 18:49:09.202: INFO @log_variables: train age_loss mean: 9.258479 2021-03-09 18:49:09.202: INFO @log_variables: train gender_loss mean: 0.281782 2021-03-09 18:49:09.202: INFO @log_variables: train age_mae mean: 8.686756 2021-03-09 18:49:09.202: INFO @log_variables: train gender_accuracy mean: 0.884323 2021-03-09 18:49:09.202: INFO @log_variables: train gender_confidence/loss nanmean: 0.070843 2021-03-09 18:49:09.202: INFO @log_variables: train gender_confidence/accuracy mean: 0.773059 2021-03-09 18:49:09.203: INFO @log_variables: train age_confidence/loss mean: 0.058254 2021-03-09 18:49:09.203: INFO @log_variables: train age_confidence/accuracy mean: 0.669392 2021-03-09 18:49:09.203: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:49:09.205: INFO @metrics_hook: train age_mae: 8.687 +-0.148 (13823) 2021-03-09 18:49:09.207: INFO @metrics_hook: train gender_accuracy: 0.884 +-0.005 (13823) 2021-03-09 18:49:11.561: INFO @decay_lr : LR updated to `9.4717296e-05` 2021-03-09 18:49:11.563: INFO @log_profile : T train: 19.551006 2021-03-09 18:49:11.563: INFO @log_profile : T read data: 0.412038 2021-03-09 18:49:11.563: INFO @log_profile : T hooks: 2.894833 2021-03-09 18:49:11.563: INFO @main_loop : Epoch 230 done 2021-03-09 18:49:11.563: INFO @main_loop : Training epoch 231 2021-03-09 18:49:31.180: INFO @log_variables: train loss nanmean: 1.218846 2021-03-09 18:49:31.181: INFO @log_variables: train age_loss mean: 9.278872 2021-03-09 18:49:31.181: INFO @log_variables: train gender_loss mean: 0.272002 2021-03-09 18:49:31.181: INFO @log_variables: train age_mae mean: 8.705176 2021-03-09 18:49:31.181: INFO @log_variables: train gender_accuracy mean: 0.888238 2021-03-09 18:49:31.181: INFO @log_variables: train gender_confidence/loss nanmean: 0.070061 2021-03-09 18:49:31.181: INFO @log_variables: train gender_confidence/accuracy mean: 0.785229 2021-03-09 18:49:31.181: INFO @log_variables: train age_confidence/loss mean: 0.057977 2021-03-09 18:49:31.181: INFO @log_variables: train age_confidence/accuracy mean: 0.663556 2021-03-09 18:49:31.181: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:49:31.182: INFO @metrics_hook: train age_mae: 8.705 +-0.148 (13824) 2021-03-09 18:49:31.184: INFO @metrics_hook: train gender_accuracy: 0.888 +-0.005 (13824) 2021-03-09 18:49:33.511: INFO @decay_lr : LR updated to `9.424371e-05` 2021-03-09 18:49:33.514: INFO @log_profile : T train: 18.598069 2021-03-09 18:49:33.514: INFO @log_profile : T read data: 0.490455 2021-03-09 18:49:33.514: INFO @log_profile : T hooks: 2.809829 2021-03-09 18:49:33.514: INFO @main_loop : Epoch 231 done 2021-03-09 18:49:33.515: INFO @main_loop : Training epoch 232 2021-03-09 18:49:52.573: INFO @log_variables: train loss nanmean: 1.232730 2021-03-09 18:49:52.574: INFO @log_variables: train age_loss mean: 9.404688 2021-03-09 18:49:52.574: INFO @log_variables: train gender_loss mean: 0.276455 2021-03-09 18:49:52.574: INFO @log_variables: train age_mae mean: 8.830837 2021-03-09 18:49:52.574: INFO @log_variables: train gender_accuracy mean: 0.883247 2021-03-09 18:49:52.574: INFO @log_variables: train gender_confidence/loss nanmean: 0.069217 2021-03-09 18:49:52.574: INFO @log_variables: train gender_confidence/accuracy mean: 0.780961 2021-03-09 18:49:52.574: INFO @log_variables: train age_confidence/loss mean: 0.057219 2021-03-09 18:49:52.574: INFO @log_variables: train age_confidence/accuracy mean: 0.672888 2021-03-09 18:49:52.574: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:49:52.577: INFO @metrics_hook: train age_mae: 8.831 +-0.152 (13824) 2021-03-09 18:49:52.579: INFO @metrics_hook: train gender_accuracy: 0.883 +-0.005 (13824) 2021-03-09 18:49:54.754: INFO @decay_lr : LR updated to `9.377249e-05` 2021-03-09 18:49:54.756: INFO @log_profile : T train: 18.192038 2021-03-09 18:49:54.756: INFO @log_profile : T read data: 0.309728 2021-03-09 18:49:54.756: INFO @log_profile : T hooks: 2.690597 2021-03-09 18:49:54.756: INFO @main_loop : Epoch 232 done 2021-03-09 18:49:54.756: INFO @main_loop : Training epoch 233 2021-03-09 18:50:13.718: INFO @log_variables: train loss nanmean: 1.200327 2021-03-09 18:50:13.718: INFO @log_variables: train age_loss mean: 9.107134 2021-03-09 18:50:13.718: INFO @log_variables: train gender_loss mean: 0.269545 2021-03-09 18:50:13.718: INFO @log_variables: train age_mae mean: 8.539726 2021-03-09 18:50:13.718: INFO @log_variables: train gender_accuracy mean: 0.888093 2021-03-09 18:50:13.718: INFO @log_variables: train gender_confidence/loss nanmean: 0.069104 2021-03-09 18:50:13.718: INFO @log_variables: train gender_confidence/accuracy mean: 0.781829 2021-03-09 18:50:13.718: INFO @log_variables: train age_confidence/loss mean: 0.058261 2021-03-09 18:50:13.719: INFO @log_variables: train age_confidence/accuracy mean: 0.667535 2021-03-09 18:50:13.719: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:50:13.721: INFO @metrics_hook: train age_mae: 8.540 +-0.146 (13824) 2021-03-09 18:50:13.723: INFO @metrics_hook: train gender_accuracy: 0.888 +-0.005 (13824) 2021-03-09 18:50:16.048: INFO @decay_lr : LR updated to `9.330363e-05` 2021-03-09 18:50:16.049: INFO @log_profile : T train: 18.110113 2021-03-09 18:50:16.049: INFO @log_profile : T read data: 0.306971 2021-03-09 18:50:16.049: INFO @log_profile : T hooks: 2.826938 2021-03-09 18:50:16.049: INFO @main_loop : Epoch 233 done 2021-03-09 18:50:16.050: INFO @main_loop : Training epoch 234 2021-03-09 18:50:34.887: INFO @log_variables: train loss nanmean: 1.225969 2021-03-09 18:50:34.887: INFO @log_variables: train age_loss mean: 9.233236 2021-03-09 18:50:34.887: INFO @log_variables: train gender_loss mean: 0.285262 2021-03-09 18:50:34.887: INFO @log_variables: train age_mae mean: 8.662354 2021-03-09 18:50:34.887: INFO @log_variables: train gender_accuracy mean: 0.878906 2021-03-09 18:50:34.887: INFO @log_variables: train gender_confidence/loss nanmean: 0.069363 2021-03-09 18:50:34.887: INFO @log_variables: train gender_confidence/accuracy mean: 0.783131 2021-03-09 18:50:34.888: INFO @log_variables: train age_confidence/loss mean: 0.057891 2021-03-09 18:50:34.888: INFO @log_variables: train age_confidence/accuracy mean: 0.667462 2021-03-09 18:50:34.888: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:50:34.890: INFO @metrics_hook: train age_mae: 8.662 +-0.150 (13824) 2021-03-09 18:50:34.892: INFO @metrics_hook: train gender_accuracy: 0.879 +-0.006 (13824) 2021-03-09 18:50:37.105: INFO @decay_lr : LR updated to `9.283711e-05` 2021-03-09 18:50:37.107: INFO @log_profile : T train: 17.868693 2021-03-09 18:50:37.107: INFO @log_profile : T read data: 0.432765 2021-03-09 18:50:37.107: INFO @log_profile : T hooks: 2.706920 2021-03-09 18:50:37.107: INFO @main_loop : Epoch 234 done 2021-03-09 18:50:37.107: INFO @main_loop : Training epoch 235 2021-03-09 18:50:56.026: INFO @log_variables: train loss nanmean: 1.204963 2021-03-09 18:50:56.026: INFO @log_variables: train age_loss mean: 9.150047 2021-03-09 18:50:56.026: INFO @log_variables: train gender_loss mean: 0.271581 2021-03-09 18:50:56.026: INFO @log_variables: train age_mae mean: 8.583910 2021-03-09 18:50:56.026: INFO @log_variables: train gender_accuracy mean: 0.885417 2021-03-09 18:50:56.026: INFO @log_variables: train gender_confidence/loss nanmean: 0.068319 2021-03-09 18:50:56.026: INFO @log_variables: train gender_confidence/accuracy mean: 0.783420 2021-03-09 18:50:56.027: INFO @log_variables: train age_confidence/loss mean: 0.057930 2021-03-09 18:50:56.027: INFO @log_variables: train age_confidence/accuracy mean: 0.670645 2021-03-09 18:50:56.027: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:50:56.028: INFO @metrics_hook: train age_mae: 8.584 +-0.146 (13824) 2021-03-09 18:50:56.029: INFO @metrics_hook: train gender_accuracy: 0.885 +-0.005 (13824) 2021-03-09 18:50:58.172: INFO @decay_lr : LR updated to `9.2372924e-05` 2021-03-09 18:50:58.174: INFO @log_profile : T train: 18.067133 2021-03-09 18:50:58.174: INFO @log_profile : T read data: 0.312190 2021-03-09 18:50:58.174: INFO @log_profile : T hooks: 2.638859 2021-03-09 18:50:58.174: INFO @main_loop : Epoch 235 done 2021-03-09 18:50:58.174: INFO @main_loop : Training epoch 236 2021-03-09 18:51:16.786: INFO @log_variables: train loss nanmean: 1.207514 2021-03-09 18:51:16.786: INFO @log_variables: train age_loss mean: 9.212820 2021-03-09 18:51:16.786: INFO @log_variables: train gender_loss mean: 0.267752 2021-03-09 18:51:16.787: INFO @log_variables: train age_mae mean: 8.642931 2021-03-09 18:51:16.787: INFO @log_variables: train gender_accuracy mean: 0.886212 2021-03-09 18:51:16.787: INFO @log_variables: train gender_confidence/loss nanmean: 0.068298 2021-03-09 18:51:16.787: INFO @log_variables: train gender_confidence/accuracy mean: 0.788628 2021-03-09 18:51:16.787: INFO @log_variables: train age_confidence/loss mean: 0.058275 2021-03-09 18:51:16.787: INFO @log_variables: train age_confidence/accuracy mean: 0.667028 2021-03-09 18:51:16.787: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:51:16.789: INFO @metrics_hook: train age_mae: 8.643 +-0.149 (13824) 2021-03-09 18:51:16.792: INFO @metrics_hook: train gender_accuracy: 0.886 +-0.005 (13824) 2021-03-09 18:51:19.693: INFO @decay_lr : LR updated to `9.191106e-05` 2021-03-09 18:51:19.694: INFO @log_profile : T train: 17.750456 2021-03-09 18:51:19.694: INFO @log_profile : T read data: 0.342500 2021-03-09 18:51:19.694: INFO @log_profile : T hooks: 3.375719 2021-03-09 18:51:19.694: INFO @main_loop : Epoch 236 done 2021-03-09 18:51:19.694: INFO @main_loop : Training epoch 237 2021-03-09 18:51:38.900: INFO @log_variables: train loss nanmean: 1.212728 2021-03-09 18:51:38.901: INFO @log_variables: train age_loss mean: 9.186366 2021-03-09 18:51:38.901: INFO @log_variables: train gender_loss mean: 0.275070 2021-03-09 18:51:38.901: INFO @log_variables: train age_mae mean: 8.614063 2021-03-09 18:51:38.901: INFO @log_variables: train gender_accuracy mean: 0.881800 2021-03-09 18:51:38.901: INFO @log_variables: train gender_confidence/loss nanmean: 0.069240 2021-03-09 18:51:38.901: INFO @log_variables: train gender_confidence/accuracy mean: 0.780888 2021-03-09 18:51:38.901: INFO @log_variables: train age_confidence/loss mean: 0.058300 2021-03-09 18:51:38.901: INFO @log_variables: train age_confidence/accuracy mean: 0.664641 2021-03-09 18:51:38.902: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:51:38.904: INFO @metrics_hook: train age_mae: 8.614 +-0.147 (13824) 2021-03-09 18:51:38.907: INFO @metrics_hook: train gender_accuracy: 0.882 +-0.005 (13824) 2021-03-09 18:51:41.746: INFO @decay_lr : LR updated to `9.1451504e-05` 2021-03-09 18:51:41.751: INFO @log_profile : T train: 18.099433 2021-03-09 18:51:41.751: INFO @log_profile : T read data: 0.565535 2021-03-09 18:51:41.751: INFO @log_profile : T hooks: 3.336587 2021-03-09 18:51:41.752: INFO @main_loop : Epoch 237 done 2021-03-09 18:51:41.752: INFO @main_loop : Training epoch 238 2021-03-09 18:52:00.540: INFO @log_variables: train loss nanmean: 1.215127 2021-03-09 18:52:00.540: INFO @log_variables: train age_loss mean: 9.202116 2021-03-09 18:52:00.540: INFO @log_variables: train gender_loss mean: 0.274927 2021-03-09 18:52:00.540: INFO @log_variables: train age_mae mean: 8.631172 2021-03-09 18:52:00.540: INFO @log_variables: train gender_accuracy mean: 0.886719 2021-03-09 18:52:00.540: INFO @log_variables: train gender_confidence/loss nanmean: 0.070485 2021-03-09 18:52:00.540: INFO @log_variables: train gender_confidence/accuracy mean: 0.778139 2021-03-09 18:52:00.540: INFO @log_variables: train age_confidence/loss mean: 0.058153 2021-03-09 18:52:00.540: INFO @log_variables: train age_confidence/accuracy mean: 0.666088 2021-03-09 18:52:00.540: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:52:00.543: INFO @metrics_hook: train age_mae: 8.631 +-0.148 (13824) 2021-03-09 18:52:00.545: INFO @metrics_hook: train gender_accuracy: 0.887 +-0.005 (13824) 2021-03-09 18:52:03.721: INFO @decay_lr : LR updated to `9.099425e-05` 2021-03-09 18:52:03.726: INFO @log_profile : T train: 17.859736 2021-03-09 18:52:03.728: INFO @log_profile : T read data: 0.396126 2021-03-09 18:52:03.728: INFO @log_profile : T hooks: 3.663037 2021-03-09 18:52:03.729: INFO @main_loop : Epoch 238 done 2021-03-09 18:52:03.729: INFO @main_loop : Training epoch 239 2021-03-09 18:52:24.160: INFO @log_variables: train loss nanmean: 1.218585 2021-03-09 18:52:24.160: INFO @log_variables: train age_loss mean: 9.206870 2021-03-09 18:52:24.160: INFO @log_variables: train gender_loss mean: 0.279213 2021-03-09 18:52:24.160: INFO @log_variables: train age_mae mean: 8.636413 2021-03-09 18:52:24.160: INFO @log_variables: train gender_accuracy mean: 0.883753 2021-03-09 18:52:24.160: INFO @log_variables: train gender_confidence/loss nanmean: 0.069984 2021-03-09 18:52:24.161: INFO @log_variables: train gender_confidence/accuracy mean: 0.779297 2021-03-09 18:52:24.161: INFO @log_variables: train age_confidence/loss mean: 0.057784 2021-03-09 18:52:24.161: INFO @log_variables: train age_confidence/accuracy mean: 0.671007 2021-03-09 18:52:24.161: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:52:24.163: INFO @metrics_hook: train age_mae: 8.636 +-0.147 (13824) 2021-03-09 18:52:24.165: INFO @metrics_hook: train gender_accuracy: 0.884 +-0.005 (13824) 2021-03-09 18:52:26.742: INFO @decay_lr : LR updated to `9.053927e-05` 2021-03-09 18:52:26.745: INFO @log_profile : T train: 19.392915 2021-03-09 18:52:26.745: INFO @log_profile : T read data: 0.516742 2021-03-09 18:52:26.745: INFO @log_profile : T hooks: 3.051182 2021-03-09 18:52:26.745: INFO @main_loop : Epoch 239 done 2021-03-09 18:52:26.745: INFO @main_loop : Training epoch 240 2021-03-09 18:52:45.236: INFO @log_variables: train loss nanmean: 1.211298 2021-03-09 18:52:45.237: INFO @log_variables: train age_loss mean: 9.098647 2021-03-09 18:52:45.237: INFO @log_variables: train gender_loss mean: 0.280608 2021-03-09 18:52:45.238: INFO @log_variables: train age_mae mean: 8.531021 2021-03-09 18:52:45.238: INFO @log_variables: train gender_accuracy mean: 0.881655 2021-03-09 18:52:45.238: INFO @log_variables: train gender_confidence/loss nanmean: 0.070627 2021-03-09 18:52:45.238: INFO @log_variables: train gender_confidence/accuracy mean: 0.775246 2021-03-09 18:52:45.238: INFO @log_variables: train age_confidence/loss mean: 0.058423 2021-03-09 18:52:45.238: INFO @log_variables: train age_confidence/accuracy mean: 0.667245 2021-03-09 18:52:45.238: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:52:45.239: INFO @metrics_hook: train age_mae: 8.531 +-0.147 (13824) 2021-03-09 18:52:45.241: INFO @metrics_hook: train gender_accuracy: 0.882 +-0.005 (13824) 2021-03-09 18:52:47.563: INFO @decay_lr : LR updated to `9.008658e-05` 2021-03-09 18:52:47.566: INFO @log_profile : T train: 17.491403 2021-03-09 18:52:47.566: INFO @log_profile : T read data: 0.470178 2021-03-09 18:52:47.566: INFO @log_profile : T hooks: 2.807346 2021-03-09 18:52:47.566: INFO @main_loop : Epoch 240 done 2021-03-09 18:52:47.566: INFO @main_loop : Training epoch 241 2021-03-09 18:53:05.780: INFO @log_variables: train loss nanmean: 1.220473 2021-03-09 18:53:05.781: INFO @log_variables: train age_loss mean: 9.210044 2021-03-09 18:53:05.781: INFO @log_variables: train gender_loss mean: 0.281619 2021-03-09 18:53:05.781: INFO @log_variables: train age_mae mean: 8.640326 2021-03-09 18:53:05.781: INFO @log_variables: train gender_accuracy mean: 0.881366 2021-03-09 18:53:05.781: INFO @log_variables: train gender_confidence/loss nanmean: 0.069342 2021-03-09 18:53:05.781: INFO @log_variables: train gender_confidence/accuracy mean: 0.779948 2021-03-09 18:53:05.781: INFO @log_variables: train age_confidence/loss mean: 0.057837 2021-03-09 18:53:05.781: INFO @log_variables: train age_confidence/accuracy mean: 0.673683 2021-03-09 18:53:05.781: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:53:05.783: INFO @metrics_hook: train age_mae: 8.640 +-0.147 (13824) 2021-03-09 18:53:05.785: INFO @metrics_hook: train gender_accuracy: 0.881 +-0.006 (13824) 2021-03-09 18:53:08.100: INFO @decay_lr : LR updated to `8.9636145e-05` 2021-03-09 18:53:08.102: INFO @log_profile : T train: 17.359803 2021-03-09 18:53:08.102: INFO @log_profile : T read data: 0.336031 2021-03-09 18:53:08.102: INFO @log_profile : T hooks: 2.789387 2021-03-09 18:53:08.102: INFO @main_loop : Epoch 241 done 2021-03-09 18:53:08.102: INFO @main_loop : Training epoch 242 2021-03-09 18:53:27.441: INFO @log_variables: train loss nanmean: 1.210211 2021-03-09 18:53:27.441: INFO @log_variables: train age_loss mean: 9.124458 2021-03-09 18:53:27.441: INFO @log_variables: train gender_loss mean: 0.277802 2021-03-09 18:53:27.441: INFO @log_variables: train age_mae mean: 8.557474 2021-03-09 18:53:27.441: INFO @log_variables: train gender_accuracy mean: 0.882451 2021-03-09 18:53:27.441: INFO @log_variables: train gender_confidence/loss nanmean: 0.069246 2021-03-09 18:53:27.441: INFO @log_variables: train gender_confidence/accuracy mean: 0.782986 2021-03-09 18:53:27.441: INFO @log_variables: train age_confidence/loss mean: 0.058922 2021-03-09 18:53:27.441: INFO @log_variables: train age_confidence/accuracy mean: 0.660807 2021-03-09 18:53:27.441: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:53:27.443: INFO @metrics_hook: train age_mae: 8.557 +-0.148 (13824) 2021-03-09 18:53:27.444: INFO @metrics_hook: train gender_accuracy: 0.882 +-0.005 (13824) 2021-03-09 18:53:29.805: INFO @decay_lr : LR updated to `8.918797e-05` 2021-03-09 18:53:29.807: INFO @log_profile : T train: 18.464081 2021-03-09 18:53:29.807: INFO @log_profile : T read data: 0.345476 2021-03-09 18:53:29.807: INFO @log_profile : T hooks: 2.844286 2021-03-09 18:53:29.807: INFO @main_loop : Epoch 242 done 2021-03-09 18:53:29.807: INFO @main_loop : Training epoch 243 2021-03-09 18:53:49.188: INFO @log_variables: train loss nanmean: 1.208988 2021-03-09 18:53:49.188: INFO @log_variables: train age_loss mean: 9.132021 2021-03-09 18:53:49.188: INFO @log_variables: train gender_loss mean: 0.277118 2021-03-09 18:53:49.188: INFO @log_variables: train age_mae mean: 8.563594 2021-03-09 18:53:49.188: INFO @log_variables: train gender_accuracy mean: 0.883527 2021-03-09 18:53:49.188: INFO @log_variables: train gender_confidence/loss nanmean: 0.068657 2021-03-09 18:53:49.188: INFO @log_variables: train gender_confidence/accuracy mean: 0.784056 2021-03-09 18:53:49.188: INFO @log_variables: train age_confidence/loss mean: 0.058222 2021-03-09 18:53:49.188: INFO @log_variables: train age_confidence/accuracy mean: 0.663604 2021-03-09 18:53:49.188: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:53:49.190: INFO @metrics_hook: train age_mae: 8.564 +-0.147 (13823) 2021-03-09 18:53:49.192: INFO @metrics_hook: train gender_accuracy: 0.884 +-0.005 (13823) 2021-03-09 18:53:51.585: INFO @decay_lr : LR updated to `8.8742025e-05` 2021-03-09 18:53:51.586: INFO @log_profile : T train: 18.508215 2021-03-09 18:53:51.587: INFO @log_profile : T read data: 0.333815 2021-03-09 18:53:51.587: INFO @log_profile : T hooks: 2.885056 2021-03-09 18:53:51.587: INFO @main_loop : Epoch 243 done 2021-03-09 18:53:51.587: INFO @main_loop : Training epoch 244 2021-03-09 18:54:11.583: INFO @log_variables: train loss nanmean: 1.201360 2021-03-09 18:54:11.585: INFO @log_variables: train age_loss mean: 9.087391 2021-03-09 18:54:11.585: INFO @log_variables: train gender_loss mean: 0.273507 2021-03-09 18:54:11.585: INFO @log_variables: train age_mae mean: 8.520678 2021-03-09 18:54:11.585: INFO @log_variables: train gender_accuracy mean: 0.881076 2021-03-09 18:54:11.585: INFO @log_variables: train gender_confidence/loss nanmean: 0.068377 2021-03-09 18:54:11.585: INFO @log_variables: train gender_confidence/accuracy mean: 0.786241 2021-03-09 18:54:11.585: INFO @log_variables: train age_confidence/loss mean: 0.058214 2021-03-09 18:54:11.585: INFO @log_variables: train age_confidence/accuracy mean: 0.669199 2021-03-09 18:54:11.585: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:54:11.587: INFO @metrics_hook: train age_mae: 8.521 +-0.144 (13824) 2021-03-09 18:54:11.590: INFO @metrics_hook: train gender_accuracy: 0.881 +-0.006 (13824) 2021-03-09 18:54:14.764: INFO @decay_lr : LR updated to `8.8298315e-05` 2021-03-09 18:54:14.768: INFO @log_profile : T train: 18.843659 2021-03-09 18:54:14.768: INFO @log_profile : T read data: 0.596997 2021-03-09 18:54:14.768: INFO @log_profile : T hooks: 3.685741 2021-03-09 18:54:14.768: INFO @main_loop : Epoch 244 done 2021-03-09 18:54:14.768: INFO @main_loop : Training epoch 245 2021-03-09 18:54:36.066: INFO @log_variables: train loss nanmean: 1.196829 2021-03-09 18:54:36.066: INFO @log_variables: train age_loss mean: 9.065137 2021-03-09 18:54:36.066: INFO @log_variables: train gender_loss mean: 0.269695 2021-03-09 18:54:36.066: INFO @log_variables: train age_mae mean: 8.498594 2021-03-09 18:54:36.067: INFO @log_variables: train gender_accuracy mean: 0.887297 2021-03-09 18:54:36.067: INFO @log_variables: train gender_confidence/loss nanmean: 0.068844 2021-03-09 18:54:36.067: INFO @log_variables: train gender_confidence/accuracy mean: 0.783348 2021-03-09 18:54:36.067: INFO @log_variables: train age_confidence/loss mean: 0.058705 2021-03-09 18:54:36.067: INFO @log_variables: train age_confidence/accuracy mean: 0.661531 2021-03-09 18:54:36.067: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:54:36.069: INFO @metrics_hook: train age_mae: 8.499 +-0.147 (13824) 2021-03-09 18:54:36.071: INFO @metrics_hook: train gender_accuracy: 0.887 +-0.005 (13824) 2021-03-09 18:54:38.937: INFO @decay_lr : LR updated to `8.7856824e-05` 2021-03-09 18:54:38.939: INFO @log_profile : T train: 20.276959 2021-03-09 18:54:38.939: INFO @log_profile : T read data: 0.460479 2021-03-09 18:54:38.939: INFO @log_profile : T hooks: 3.377866 2021-03-09 18:54:38.939: INFO @main_loop : Epoch 245 done 2021-03-09 18:54:38.939: INFO @main_loop : Training epoch 246 2021-03-09 18:55:00.517: INFO @log_variables: train loss nanmean: 1.208161 2021-03-09 18:55:00.517: INFO @log_variables: train age_loss mean: 9.132727 2021-03-09 18:55:00.517: INFO @log_variables: train gender_loss mean: 0.273708 2021-03-09 18:55:00.517: INFO @log_variables: train age_mae mean: 8.566797 2021-03-09 18:55:00.517: INFO @log_variables: train gender_accuracy mean: 0.885851 2021-03-09 18:55:00.517: INFO @log_variables: train gender_confidence/loss nanmean: 0.070527 2021-03-09 18:55:00.518: INFO @log_variables: train gender_confidence/accuracy mean: 0.784288 2021-03-09 18:55:00.518: INFO @log_variables: train age_confidence/loss mean: 0.058562 2021-03-09 18:55:00.518: INFO @log_variables: train age_confidence/accuracy mean: 0.663122 2021-03-09 18:55:00.518: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:55:00.520: INFO @metrics_hook: train age_mae: 8.567 +-0.147 (13824) 2021-03-09 18:55:00.527: INFO @metrics_hook: train gender_accuracy: 0.886 +-0.005 (13824) 2021-03-09 18:55:03.789: INFO @decay_lr : LR updated to `8.741754e-05` 2021-03-09 18:55:03.791: INFO @log_profile : T train: 20.476914 2021-03-09 18:55:03.791: INFO @log_profile : T read data: 0.509499 2021-03-09 18:55:03.791: INFO @log_profile : T hooks: 3.806545 2021-03-09 18:55:03.791: INFO @main_loop : Epoch 246 done 2021-03-09 18:55:03.791: INFO @main_loop : Training epoch 247 2021-03-09 18:55:27.084: INFO @log_variables: train loss nanmean: 1.214499 2021-03-09 18:55:27.084: INFO @log_variables: train age_loss mean: 9.207426 2021-03-09 18:55:27.084: INFO @log_variables: train gender_loss mean: 0.274303 2021-03-09 18:55:27.084: INFO @log_variables: train age_mae mean: 8.638518 2021-03-09 18:55:27.084: INFO @log_variables: train gender_accuracy mean: 0.884693 2021-03-09 18:55:27.084: INFO @log_variables: train gender_confidence/loss nanmean: 0.070568 2021-03-09 18:55:27.084: INFO @log_variables: train gender_confidence/accuracy mean: 0.775535 2021-03-09 18:55:27.084: INFO @log_variables: train age_confidence/loss mean: 0.057527 2021-03-09 18:55:27.084: INFO @log_variables: train age_confidence/accuracy mean: 0.675130 2021-03-09 18:55:27.084: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:55:27.086: INFO @metrics_hook: train age_mae: 8.639 +-0.148 (13824) 2021-03-09 18:55:27.088: INFO @metrics_hook: train gender_accuracy: 0.885 +-0.005 (13824) 2021-03-09 18:55:30.270: INFO @decay_lr : LR updated to `8.698045e-05` 2021-03-09 18:55:30.271: INFO @log_profile : T train: 21.786818 2021-03-09 18:55:30.271: INFO @log_profile : T read data: 0.898448 2021-03-09 18:55:30.271: INFO @log_profile : T hooks: 3.728857 2021-03-09 18:55:30.272: INFO @main_loop : Epoch 247 done 2021-03-09 18:55:30.272: INFO @main_loop : Training epoch 248 2021-03-09 18:55:51.047: INFO @log_variables: train loss nanmean: 1.195980 2021-03-09 18:55:51.047: INFO @log_variables: train age_loss mean: 8.994801 2021-03-09 18:55:51.047: INFO @log_variables: train gender_loss mean: 0.274687 2021-03-09 18:55:51.047: INFO @log_variables: train age_mae mean: 8.432136 2021-03-09 18:55:51.047: INFO @log_variables: train gender_accuracy mean: 0.886357 2021-03-09 18:55:51.047: INFO @log_variables: train gender_confidence/loss nanmean: 0.069647 2021-03-09 18:55:51.047: INFO @log_variables: train gender_confidence/accuracy mean: 0.783999 2021-03-09 18:55:51.047: INFO @log_variables: train age_confidence/loss mean: 0.058909 2021-03-09 18:55:51.047: INFO @log_variables: train age_confidence/accuracy mean: 0.663628 2021-03-09 18:55:51.047: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:55:51.049: INFO @metrics_hook: train age_mae: 8.432 +-0.145 (13824) 2021-03-09 18:55:51.051: INFO @metrics_hook: train gender_accuracy: 0.886 +-0.005 (13824) 2021-03-09 18:55:53.360: INFO @decay_lr : LR updated to `8.6545544e-05` 2021-03-09 18:55:53.362: INFO @log_profile : T train: 19.746846 2021-03-09 18:55:53.362: INFO @log_profile : T read data: 0.465888 2021-03-09 18:55:53.362: INFO @log_profile : T hooks: 2.823064 2021-03-09 18:55:53.362: INFO @main_loop : Epoch 248 done 2021-03-09 18:55:53.362: INFO @main_loop : Training epoch 249 2021-03-09 18:56:12.937: INFO @log_variables: train loss nanmean: 1.191824 2021-03-09 18:56:12.937: INFO @log_variables: train age_loss mean: 9.021337 2021-03-09 18:56:12.937: INFO @log_variables: train gender_loss mean: 0.269971 2021-03-09 18:56:12.937: INFO @log_variables: train age_mae mean: 8.461330 2021-03-09 18:56:12.937: INFO @log_variables: train gender_accuracy mean: 0.886285 2021-03-09 18:56:12.937: INFO @log_variables: train gender_confidence/loss nanmean: 0.068491 2021-03-09 18:56:12.937: INFO @log_variables: train gender_confidence/accuracy mean: 0.779731 2021-03-09 18:56:12.937: INFO @log_variables: train age_confidence/loss mean: 0.057783 2021-03-09 18:56:12.937: INFO @log_variables: train age_confidence/accuracy mean: 0.676794 2021-03-09 18:56:12.938: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:56:12.939: INFO @metrics_hook: train age_mae: 8.461 +-0.144 (13824) 2021-03-09 18:56:12.940: INFO @metrics_hook: train gender_accuracy: 0.886 +-0.005 (13824) 2021-03-09 18:56:15.299: INFO @decay_lr : LR updated to `8.6112814e-05` 2021-03-09 18:56:15.302: INFO @log_profile : T train: 18.654472 2021-03-09 18:56:15.302: INFO @log_profile : T read data: 0.370198 2021-03-09 18:56:15.302: INFO @log_profile : T hooks: 2.862523 2021-03-09 18:56:15.302: INFO @main_loop : Epoch 249 done 2021-03-09 18:56:15.302: INFO @main_loop : Training epoch 250 2021-03-09 18:56:35.038: INFO @log_variables: train loss nanmean: 1.210823 2021-03-09 18:56:35.039: INFO @log_variables: train age_loss mean: 9.174419 2021-03-09 18:56:35.039: INFO @log_variables: train gender_loss mean: 0.275054 2021-03-09 18:56:35.039: INFO @log_variables: train age_mae mean: 8.610472 2021-03-09 18:56:35.039: INFO @log_variables: train gender_accuracy mean: 0.881800 2021-03-09 18:56:35.039: INFO @log_variables: train gender_confidence/loss nanmean: 0.068632 2021-03-09 18:56:35.040: INFO @log_variables: train gender_confidence/accuracy mean: 0.783565 2021-03-09 18:56:35.040: INFO @log_variables: train age_confidence/loss mean: 0.058104 2021-03-09 18:56:35.040: INFO @log_variables: train age_confidence/accuracy mean: 0.666016 2021-03-09 18:56:35.040: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:56:35.044: INFO @metrics_hook: train age_mae: 8.610 +-0.149 (13824) 2021-03-09 18:56:35.048: INFO @metrics_hook: train gender_accuracy: 0.882 +-0.005 (13824) 2021-03-09 18:56:37.471: INFO @decay_lr : LR updated to `8.568225e-05` 2021-03-09 18:56:37.473: INFO @log_profile : T train: 18.690687 2021-03-09 18:56:37.473: INFO @log_profile : T read data: 0.475897 2021-03-09 18:56:37.473: INFO @log_profile : T hooks: 2.952208 2021-03-09 18:56:37.473: INFO @main_loop : Epoch 250 done 2021-03-09 18:56:37.474: INFO @main_loop : Training epoch 251 2021-03-09 18:56:56.747: INFO @log_variables: train loss nanmean: 1.187255 2021-03-09 18:56:56.747: INFO @log_variables: train age_loss mean: 8.993891 2021-03-09 18:56:56.747: INFO @log_variables: train gender_loss mean: 0.266043 2021-03-09 18:56:56.747: INFO @log_variables: train age_mae mean: 8.430686 2021-03-09 18:56:56.747: INFO @log_variables: train gender_accuracy mean: 0.887868 2021-03-09 18:56:56.747: INFO @log_variables: train gender_confidence/loss nanmean: 0.069256 2021-03-09 18:56:56.747: INFO @log_variables: train gender_confidence/accuracy mean: 0.783983 2021-03-09 18:56:56.747: INFO @log_variables: train age_confidence/loss mean: 0.058515 2021-03-09 18:56:56.748: INFO @log_variables: train age_confidence/accuracy mean: 0.663387 2021-03-09 18:56:56.748: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:56:56.749: INFO @metrics_hook: train age_mae: 8.431 +-0.147 (13823) 2021-03-09 18:56:56.750: INFO @metrics_hook: train gender_accuracy: 0.888 +-0.005 (13823) 2021-03-09 18:56:59.107: INFO @decay_lr : LR updated to `8.525384e-05` 2021-03-09 18:56:59.110: INFO @log_profile : T train: 18.370454 2021-03-09 18:56:59.110: INFO @log_profile : T read data: 0.349787 2021-03-09 18:56:59.110: INFO @log_profile : T hooks: 2.860399 2021-03-09 18:56:59.111: INFO @main_loop : Epoch 251 done 2021-03-09 18:56:59.111: INFO @main_loop : Training epoch 252 2021-03-09 18:57:18.821: INFO @log_variables: train loss nanmean: 1.180261 2021-03-09 18:57:18.822: INFO @log_variables: train age_loss mean: 8.941651 2021-03-09 18:57:18.822: INFO @log_variables: train gender_loss mean: 0.263873 2021-03-09 18:57:18.822: INFO @log_variables: train age_mae mean: 8.380427 2021-03-09 18:57:18.822: INFO @log_variables: train gender_accuracy mean: 0.889612 2021-03-09 18:57:18.822: INFO @log_variables: train gender_confidence/loss nanmean: 0.069065 2021-03-09 18:57:18.822: INFO @log_variables: train gender_confidence/accuracy mean: 0.788628 2021-03-09 18:57:18.822: INFO @log_variables: train age_confidence/loss mean: 0.058434 2021-03-09 18:57:18.822: INFO @log_variables: train age_confidence/accuracy mean: 0.666233 2021-03-09 18:57:18.822: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:57:18.824: INFO @metrics_hook: train age_mae: 8.380 +-0.143 (13824) 2021-03-09 18:57:18.826: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 18:57:21.692: INFO @decay_lr : LR updated to `8.4827574e-05` 2021-03-09 18:57:21.695: INFO @log_profile : T train: 18.809110 2021-03-09 18:57:21.695: INFO @log_profile : T read data: 0.363649 2021-03-09 18:57:21.695: INFO @log_profile : T hooks: 3.354589 2021-03-09 18:57:21.695: INFO @main_loop : Epoch 252 done 2021-03-09 18:57:21.695: INFO @main_loop : Training epoch 253 2021-03-09 18:57:43.755: INFO @log_variables: train loss nanmean: 1.193058 2021-03-09 18:57:43.756: INFO @log_variables: train age_loss mean: 9.055523 2021-03-09 18:57:43.756: INFO @log_variables: train gender_loss mean: 0.267860 2021-03-09 18:57:43.756: INFO @log_variables: train age_mae mean: 8.490028 2021-03-09 18:57:43.756: INFO @log_variables: train gender_accuracy mean: 0.887442 2021-03-09 18:57:43.756: INFO @log_variables: train gender_confidence/loss nanmean: 0.068437 2021-03-09 18:57:43.756: INFO @log_variables: train gender_confidence/accuracy mean: 0.786314 2021-03-09 18:57:43.756: INFO @log_variables: train age_confidence/loss mean: 0.057882 2021-03-09 18:57:43.756: INFO @log_variables: train age_confidence/accuracy mean: 0.671007 2021-03-09 18:57:43.756: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:57:43.758: INFO @metrics_hook: train age_mae: 8.490 +-0.145 (13824) 2021-03-09 18:57:43.760: INFO @metrics_hook: train gender_accuracy: 0.887 +-0.005 (13824) 2021-03-09 18:57:46.740: INFO @decay_lr : LR updated to `8.440344e-05` 2021-03-09 18:57:46.742: INFO @log_profile : T train: 20.859807 2021-03-09 18:57:46.742: INFO @log_profile : T read data: 0.655147 2021-03-09 18:57:46.742: INFO @log_profile : T hooks: 3.471144 2021-03-09 18:57:46.742: INFO @main_loop : Epoch 253 done 2021-03-09 18:57:46.742: INFO @main_loop : Training epoch 254 2021-03-09 18:58:08.734: INFO @log_variables: train loss nanmean: 1.200654 2021-03-09 18:58:08.735: INFO @log_variables: train age_loss mean: 9.145499 2021-03-09 18:58:08.735: INFO @log_variables: train gender_loss mean: 0.266954 2021-03-09 18:58:08.735: INFO @log_variables: train age_mae mean: 8.578438 2021-03-09 18:58:08.735: INFO @log_variables: train gender_accuracy mean: 0.887297 2021-03-09 18:58:08.735: INFO @log_variables: train gender_confidence/loss nanmean: 0.067898 2021-03-09 18:58:08.735: INFO @log_variables: train gender_confidence/accuracy mean: 0.791739 2021-03-09 18:58:08.735: INFO @log_variables: train age_confidence/loss mean: 0.058661 2021-03-09 18:58:08.735: INFO @log_variables: train age_confidence/accuracy mean: 0.665437 2021-03-09 18:58:08.735: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:58:08.737: INFO @metrics_hook: train age_mae: 8.578 +-0.147 (13824) 2021-03-09 18:58:08.740: INFO @metrics_hook: train gender_accuracy: 0.887 +-0.005 (13824) 2021-03-09 18:58:11.486: INFO @decay_lr : LR updated to `8.398142e-05` 2021-03-09 18:58:11.487: INFO @log_profile : T train: 20.977234 2021-03-09 18:58:11.487: INFO @log_profile : T read data: 0.424702 2021-03-09 18:58:11.487: INFO @log_profile : T hooks: 3.276986 2021-03-09 18:58:11.487: INFO @main_loop : Epoch 254 done 2021-03-09 18:58:11.487: INFO @main_loop : Training epoch 255 2021-03-09 18:58:33.588: INFO @log_variables: train loss nanmean: 1.197617 2021-03-09 18:58:33.589: INFO @log_variables: train age_loss mean: 9.034620 2021-03-09 18:58:33.591: INFO @log_variables: train gender_loss mean: 0.273226 2021-03-09 18:58:33.593: INFO @log_variables: train age_mae mean: 8.470277 2021-03-09 18:58:33.594: INFO @log_variables: train gender_accuracy mean: 0.885200 2021-03-09 18:58:33.594: INFO @log_variables: train gender_confidence/loss nanmean: 0.069530 2021-03-09 18:58:33.594: INFO @log_variables: train gender_confidence/accuracy mean: 0.784650 2021-03-09 18:58:33.594: INFO @log_variables: train age_confidence/loss mean: 0.058371 2021-03-09 18:58:33.594: INFO @log_variables: train age_confidence/accuracy mean: 0.667462 2021-03-09 18:58:33.594: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:58:33.596: INFO @metrics_hook: train age_mae: 8.470 +-0.145 (13824) 2021-03-09 18:58:33.597: INFO @metrics_hook: train gender_accuracy: 0.885 +-0.005 (13824) 2021-03-09 18:58:36.474: INFO @decay_lr : LR updated to `8.356151e-05` 2021-03-09 18:58:36.476: INFO @log_profile : T train: 20.984621 2021-03-09 18:58:36.476: INFO @log_profile : T read data: 0.552960 2021-03-09 18:58:36.476: INFO @log_profile : T hooks: 3.396453 2021-03-09 18:58:36.477: INFO @main_loop : Epoch 255 done 2021-03-09 18:58:36.477: INFO @main_loop : Training epoch 256 2021-03-09 18:58:58.382: INFO @log_variables: train loss nanmean: 1.183721 2021-03-09 18:58:58.382: INFO @log_variables: train age_loss mean: 9.020122 2021-03-09 18:58:58.382: INFO @log_variables: train gender_loss mean: 0.259613 2021-03-09 18:58:58.382: INFO @log_variables: train age_mae mean: 8.455462 2021-03-09 18:58:58.383: INFO @log_variables: train gender_accuracy mean: 0.892072 2021-03-09 18:58:58.383: INFO @log_variables: train gender_confidence/loss nanmean: 0.069105 2021-03-09 18:58:58.383: INFO @log_variables: train gender_confidence/accuracy mean: 0.781539 2021-03-09 18:58:58.383: INFO @log_variables: train age_confidence/loss mean: 0.058592 2021-03-09 18:58:58.383: INFO @log_variables: train age_confidence/accuracy mean: 0.665509 2021-03-09 18:58:58.383: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:58:58.387: INFO @metrics_hook: train age_mae: 8.455 +-0.145 (13824) 2021-03-09 18:58:58.390: INFO @metrics_hook: train gender_accuracy: 0.892 +-0.005 (13824) 2021-03-09 18:59:01.057: INFO @decay_lr : LR updated to `8.31437e-05` 2021-03-09 18:59:01.059: INFO @log_profile : T train: 20.672500 2021-03-09 18:59:01.059: INFO @log_profile : T read data: 0.662936 2021-03-09 18:59:01.059: INFO @log_profile : T hooks: 3.188561 2021-03-09 18:59:01.059: INFO @main_loop : Epoch 256 done 2021-03-09 18:59:01.059: INFO @main_loop : Training epoch 257 2021-03-09 18:59:20.431: INFO @log_variables: train loss nanmean: 1.194700 2021-03-09 18:59:20.431: INFO @log_variables: train age_loss mean: 9.064787 2021-03-09 18:59:20.432: INFO @log_variables: train gender_loss mean: 0.267336 2021-03-09 18:59:20.432: INFO @log_variables: train age_mae mean: 8.499905 2021-03-09 18:59:20.432: INFO @log_variables: train gender_accuracy mean: 0.890336 2021-03-09 18:59:20.432: INFO @log_variables: train gender_confidence/loss nanmean: 0.069375 2021-03-09 18:59:20.432: INFO @log_variables: train gender_confidence/accuracy mean: 0.782046 2021-03-09 18:59:20.432: INFO @log_variables: train age_confidence/loss mean: 0.058221 2021-03-09 18:59:20.432: INFO @log_variables: train age_confidence/accuracy mean: 0.671152 2021-03-09 18:59:20.432: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:59:20.434: INFO @metrics_hook: train age_mae: 8.500 +-0.147 (13824) 2021-03-09 18:59:20.436: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 18:59:22.506: INFO @decay_lr : LR updated to `8.272798e-05` 2021-03-09 18:59:22.508: INFO @log_profile : T train: 18.461693 2021-03-09 18:59:22.508: INFO @log_profile : T read data: 0.330870 2021-03-09 18:59:22.508: INFO @log_profile : T hooks: 2.604188 2021-03-09 18:59:22.508: INFO @main_loop : Epoch 257 done 2021-03-09 18:59:22.508: INFO @main_loop : Training epoch 258 2021-03-09 18:59:41.528: INFO @log_variables: train loss nanmean: 1.184444 2021-03-09 18:59:41.529: INFO @log_variables: train age_loss mean: 8.973258 2021-03-09 18:59:41.529: INFO @log_variables: train gender_loss mean: 0.264902 2021-03-09 18:59:41.529: INFO @log_variables: train age_mae mean: 8.409520 2021-03-09 18:59:41.529: INFO @log_variables: train gender_accuracy mean: 0.891204 2021-03-09 18:59:41.529: INFO @log_variables: train gender_confidence/loss nanmean: 0.069675 2021-03-09 18:59:41.529: INFO @log_variables: train gender_confidence/accuracy mean: 0.784433 2021-03-09 18:59:41.529: INFO @log_variables: train age_confidence/loss mean: 0.058199 2021-03-09 18:59:41.529: INFO @log_variables: train age_confidence/accuracy mean: 0.671513 2021-03-09 18:59:41.529: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 18:59:41.531: INFO @metrics_hook: train age_mae: 8.410 +-0.145 (13824) 2021-03-09 18:59:41.533: INFO @metrics_hook: train gender_accuracy: 0.891 +-0.005 (13824) 2021-03-09 18:59:43.503: INFO @decay_lr : LR updated to `8.231434e-05` 2021-03-09 18:59:43.504: INFO @log_profile : T train: 18.144017 2021-03-09 18:59:43.504: INFO @log_profile : T read data: 0.319721 2021-03-09 18:59:43.504: INFO @log_profile : T hooks: 2.481817 2021-03-09 18:59:43.504: INFO @main_loop : Epoch 258 done 2021-03-09 18:59:43.504: INFO @main_loop : Training epoch 259 2021-03-09 19:00:02.394: INFO @log_variables: train loss nanmean: 1.203748 2021-03-09 19:00:02.394: INFO @log_variables: train age_loss mean: 9.082175 2021-03-09 19:00:02.395: INFO @log_variables: train gender_loss mean: 0.275744 2021-03-09 19:00:02.395: INFO @log_variables: train age_mae mean: 8.517808 2021-03-09 19:00:02.395: INFO @log_variables: train gender_accuracy mean: 0.884179 2021-03-09 19:00:02.395: INFO @log_variables: train gender_confidence/loss nanmean: 0.069122 2021-03-09 19:00:02.395: INFO @log_variables: train gender_confidence/accuracy mean: 0.782247 2021-03-09 19:00:02.395: INFO @log_variables: train age_confidence/loss mean: 0.058298 2021-03-09 19:00:02.395: INFO @log_variables: train age_confidence/accuracy mean: 0.669826 2021-03-09 19:00:02.395: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:00:02.396: INFO @metrics_hook: train age_mae: 8.518 +-0.147 (13823) 2021-03-09 19:00:02.397: INFO @metrics_hook: train gender_accuracy: 0.884 +-0.005 (13823) 2021-03-09 19:00:04.470: INFO @decay_lr : LR updated to `8.190277e-05` 2021-03-09 19:00:04.471: INFO @log_profile : T train: 18.019322 2021-03-09 19:00:04.471: INFO @log_profile : T read data: 0.312653 2021-03-09 19:00:04.471: INFO @log_profile : T hooks: 2.585336 2021-03-09 19:00:04.471: INFO @main_loop : Epoch 259 done 2021-03-09 19:00:04.471: INFO @main_loop : Training epoch 260 2021-03-09 19:00:23.709: INFO @log_variables: train loss nanmean: 1.173634 2021-03-09 19:00:23.709: INFO @log_variables: train age_loss mean: 8.883442 2021-03-09 19:00:23.709: INFO @log_variables: train gender_loss mean: 0.263378 2021-03-09 19:00:23.709: INFO @log_variables: train age_mae mean: 8.324108 2021-03-09 19:00:23.709: INFO @log_variables: train gender_accuracy mean: 0.888961 2021-03-09 19:00:23.710: INFO @log_variables: train gender_confidence/loss nanmean: 0.067681 2021-03-09 19:00:23.710: INFO @log_variables: train gender_confidence/accuracy mean: 0.797381 2021-03-09 19:00:23.710: INFO @log_variables: train age_confidence/loss mean: 0.058933 2021-03-09 19:00:23.710: INFO @log_variables: train age_confidence/accuracy mean: 0.663484 2021-03-09 19:00:23.710: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:00:23.711: INFO @metrics_hook: train age_mae: 8.324 +-0.142 (13824) 2021-03-09 19:00:23.712: INFO @metrics_hook: train gender_accuracy: 0.889 +-0.005 (13824) 2021-03-09 19:00:25.928: INFO @decay_lr : LR updated to `8.149326e-05` 2021-03-09 19:00:25.930: INFO @log_profile : T train: 18.224266 2021-03-09 19:00:25.930: INFO @log_profile : T read data: 0.465806 2021-03-09 19:00:25.931: INFO @log_profile : T hooks: 2.718335 2021-03-09 19:00:25.931: INFO @main_loop : Epoch 260 done 2021-03-09 19:00:25.931: INFO @main_loop : Training epoch 261 2021-03-09 19:00:45.516: INFO @log_variables: train loss nanmean: 1.178813 2021-03-09 19:00:45.517: INFO @log_variables: train age_loss mean: 8.973341 2021-03-09 19:00:45.517: INFO @log_variables: train gender_loss mean: 0.260484 2021-03-09 19:00:45.517: INFO @log_variables: train age_mae mean: 8.411106 2021-03-09 19:00:45.517: INFO @log_variables: train gender_accuracy mean: 0.890408 2021-03-09 19:00:45.517: INFO @log_variables: train gender_confidence/loss nanmean: 0.067311 2021-03-09 19:00:45.517: INFO @log_variables: train gender_confidence/accuracy mean: 0.785156 2021-03-09 19:00:45.517: INFO @log_variables: train age_confidence/loss mean: 0.058940 2021-03-09 19:00:45.517: INFO @log_variables: train age_confidence/accuracy mean: 0.664280 2021-03-09 19:00:45.518: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:00:45.520: INFO @metrics_hook: train age_mae: 8.411 +-0.146 (13824) 2021-03-09 19:00:45.524: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 19:00:47.786: INFO @decay_lr : LR updated to `8.108579e-05` 2021-03-09 19:00:47.788: INFO @log_profile : T train: 18.635290 2021-03-09 19:00:47.788: INFO @log_profile : T read data: 0.407772 2021-03-09 19:00:47.788: INFO @log_profile : T hooks: 2.762204 2021-03-09 19:00:47.788: INFO @main_loop : Epoch 261 done 2021-03-09 19:00:47.788: INFO @main_loop : Training epoch 262 2021-03-09 19:01:07.125: INFO @log_variables: train loss nanmean: 1.202485 2021-03-09 19:01:07.125: INFO @log_variables: train age_loss mean: 9.156651 2021-03-09 19:01:07.125: INFO @log_variables: train gender_loss mean: 0.267105 2021-03-09 19:01:07.125: INFO @log_variables: train age_mae mean: 8.589580 2021-03-09 19:01:07.125: INFO @log_variables: train gender_accuracy mean: 0.888889 2021-03-09 19:01:07.126: INFO @log_variables: train gender_confidence/loss nanmean: 0.069041 2021-03-09 19:01:07.126: INFO @log_variables: train gender_confidence/accuracy mean: 0.783131 2021-03-09 19:01:07.126: INFO @log_variables: train age_confidence/loss mean: 0.058199 2021-03-09 19:01:07.126: INFO @log_variables: train age_confidence/accuracy mean: 0.670573 2021-03-09 19:01:07.126: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:01:07.129: INFO @metrics_hook: train age_mae: 8.590 +-0.149 (13824) 2021-03-09 19:01:07.131: INFO @metrics_hook: train gender_accuracy: 0.889 +-0.005 (13824) 2021-03-09 19:01:09.388: INFO @decay_lr : LR updated to `8.068036e-05` 2021-03-09 19:01:09.390: INFO @log_profile : T train: 18.413176 2021-03-09 19:01:09.390: INFO @log_profile : T read data: 0.398973 2021-03-09 19:01:09.390: INFO @log_profile : T hooks: 2.736148 2021-03-09 19:01:09.390: INFO @main_loop : Epoch 262 done 2021-03-09 19:01:09.390: INFO @main_loop : Training epoch 263 2021-03-09 19:01:28.913: INFO @log_variables: train loss nanmean: 1.192472 2021-03-09 19:01:28.914: INFO @log_variables: train age_loss mean: 9.017414 2021-03-09 19:01:28.914: INFO @log_variables: train gender_loss mean: 0.270285 2021-03-09 19:01:28.914: INFO @log_variables: train age_mae mean: 8.455633 2021-03-09 19:01:28.914: INFO @log_variables: train gender_accuracy mean: 0.887587 2021-03-09 19:01:28.914: INFO @log_variables: train gender_confidence/loss nanmean: 0.068301 2021-03-09 19:01:28.914: INFO @log_variables: train gender_confidence/accuracy mean: 0.791160 2021-03-09 19:01:28.914: INFO @log_variables: train age_confidence/loss mean: 0.058692 2021-03-09 19:01:28.914: INFO @log_variables: train age_confidence/accuracy mean: 0.666884 2021-03-09 19:01:28.914: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:01:28.917: INFO @metrics_hook: train age_mae: 8.456 +-0.147 (13824) 2021-03-09 19:01:28.919: INFO @metrics_hook: train gender_accuracy: 0.888 +-0.005 (13824) 2021-03-09 19:01:31.247: INFO @decay_lr : LR updated to `8.027696e-05` 2021-03-09 19:01:31.249: INFO @log_profile : T train: 18.500513 2021-03-09 19:01:31.249: INFO @log_profile : T read data: 0.496910 2021-03-09 19:01:31.249: INFO @log_profile : T hooks: 2.808561 2021-03-09 19:01:31.249: INFO @main_loop : Epoch 263 done 2021-03-09 19:01:31.249: INFO @main_loop : Training epoch 264 2021-03-09 19:01:51.105: INFO @log_variables: train loss nanmean: 1.193869 2021-03-09 19:01:51.105: INFO @log_variables: train age_loss mean: 9.008587 2021-03-09 19:01:51.105: INFO @log_variables: train gender_loss mean: 0.270923 2021-03-09 19:01:51.105: INFO @log_variables: train age_mae mean: 8.441282 2021-03-09 19:01:51.105: INFO @log_variables: train gender_accuracy mean: 0.884983 2021-03-09 19:01:51.105: INFO @log_variables: train gender_confidence/loss nanmean: 0.069562 2021-03-09 19:01:51.105: INFO @log_variables: train gender_confidence/accuracy mean: 0.778935 2021-03-09 19:01:51.105: INFO @log_variables: train age_confidence/loss mean: 0.059050 2021-03-09 19:01:51.105: INFO @log_variables: train age_confidence/accuracy mean: 0.662833 2021-03-09 19:01:51.105: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:01:51.107: INFO @metrics_hook: train age_mae: 8.441 +-0.146 (13824) 2021-03-09 19:01:51.108: INFO @metrics_hook: train gender_accuracy: 0.885 +-0.005 (13824) 2021-03-09 19:01:53.361: INFO @decay_lr : LR updated to `7.987557e-05` 2021-03-09 19:01:53.364: INFO @log_profile : T train: 18.935671 2021-03-09 19:01:53.364: INFO @log_profile : T read data: 0.399206 2021-03-09 19:01:53.364: INFO @log_profile : T hooks: 2.727778 2021-03-09 19:01:53.364: INFO @main_loop : Epoch 264 done 2021-03-09 19:01:53.364: INFO @main_loop : Training epoch 265 2021-03-09 19:02:12.160: INFO @log_variables: train loss nanmean: 1.196167 2021-03-09 19:02:12.160: INFO @log_variables: train age_loss mean: 9.065194 2021-03-09 19:02:12.160: INFO @log_variables: train gender_loss mean: 0.268925 2021-03-09 19:02:12.160: INFO @log_variables: train age_mae mean: 8.498544 2021-03-09 19:02:12.160: INFO @log_variables: train gender_accuracy mean: 0.887442 2021-03-09 19:02:12.160: INFO @log_variables: train gender_confidence/loss nanmean: 0.068829 2021-03-09 19:02:12.160: INFO @log_variables: train gender_confidence/accuracy mean: 0.784071 2021-03-09 19:02:12.160: INFO @log_variables: train age_confidence/loss mean: 0.058753 2021-03-09 19:02:12.160: INFO @log_variables: train age_confidence/accuracy mean: 0.659361 2021-03-09 19:02:12.161: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:02:12.162: INFO @metrics_hook: train age_mae: 8.499 +-0.148 (13824) 2021-03-09 19:02:12.163: INFO @metrics_hook: train gender_accuracy: 0.887 +-0.005 (13824) 2021-03-09 19:02:14.210: INFO @decay_lr : LR updated to `7.9476195e-05` 2021-03-09 19:02:14.212: INFO @log_profile : T train: 17.881358 2021-03-09 19:02:14.212: INFO @log_profile : T read data: 0.328824 2021-03-09 19:02:14.212: INFO @log_profile : T hooks: 2.586223 2021-03-09 19:02:14.212: INFO @main_loop : Epoch 265 done 2021-03-09 19:02:14.212: INFO @main_loop : Training epoch 266 2021-03-09 19:02:33.250: INFO @log_variables: train loss nanmean: 1.181148 2021-03-09 19:02:33.250: INFO @log_variables: train age_loss mean: 8.938154 2021-03-09 19:02:33.251: INFO @log_variables: train gender_loss mean: 0.264033 2021-03-09 19:02:33.251: INFO @log_variables: train age_mae mean: 8.378081 2021-03-09 19:02:33.251: INFO @log_variables: train gender_accuracy mean: 0.890987 2021-03-09 19:02:33.251: INFO @log_variables: train gender_confidence/loss nanmean: 0.069665 2021-03-09 19:02:33.251: INFO @log_variables: train gender_confidence/accuracy mean: 0.783926 2021-03-09 19:02:33.251: INFO @log_variables: train age_confidence/loss mean: 0.058895 2021-03-09 19:02:33.251: INFO @log_variables: train age_confidence/accuracy mean: 0.665943 2021-03-09 19:02:33.251: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:02:33.253: INFO @metrics_hook: train age_mae: 8.378 +-0.145 (13824) 2021-03-09 19:02:33.255: INFO @metrics_hook: train gender_accuracy: 0.891 +-0.005 (13824) 2021-03-09 19:02:35.325: INFO @decay_lr : LR updated to `7.907881e-05` 2021-03-09 19:02:35.326: INFO @log_profile : T train: 18.040961 2021-03-09 19:02:35.326: INFO @log_profile : T read data: 0.448769 2021-03-09 19:02:35.326: INFO @log_profile : T hooks: 2.574153 2021-03-09 19:02:35.326: INFO @main_loop : Epoch 266 done 2021-03-09 19:02:35.327: INFO @main_loop : Training epoch 267 2021-03-09 19:02:55.045: INFO @log_variables: train loss nanmean: 1.190670 2021-03-09 19:02:55.046: INFO @log_variables: train age_loss mean: 9.070585 2021-03-09 19:02:55.046: INFO @log_variables: train gender_loss mean: 0.264002 2021-03-09 19:02:55.046: INFO @log_variables: train age_mae mean: 8.506426 2021-03-09 19:02:55.046: INFO @log_variables: train gender_accuracy mean: 0.888021 2021-03-09 19:02:55.046: INFO @log_variables: train gender_confidence/loss nanmean: 0.067468 2021-03-09 19:02:55.046: INFO @log_variables: train gender_confidence/accuracy mean: 0.788556 2021-03-09 19:02:55.046: INFO @log_variables: train age_confidence/loss mean: 0.058601 2021-03-09 19:02:55.046: INFO @log_variables: train age_confidence/accuracy mean: 0.663122 2021-03-09 19:02:55.046: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:02:55.047: INFO @metrics_hook: train age_mae: 8.506 +-0.147 (13824) 2021-03-09 19:02:55.049: INFO @metrics_hook: train gender_accuracy: 0.888 +-0.005 (13824) 2021-03-09 19:02:57.578: INFO @decay_lr : LR updated to `7.868341e-05` 2021-03-09 19:02:57.579: INFO @log_profile : T train: 18.760581 2021-03-09 19:02:57.579: INFO @log_profile : T read data: 0.440373 2021-03-09 19:02:57.580: INFO @log_profile : T hooks: 2.996951 2021-03-09 19:02:57.580: INFO @main_loop : Epoch 267 done 2021-03-09 19:02:57.580: INFO @main_loop : Training epoch 268 2021-03-09 19:03:16.853: INFO @log_variables: train loss nanmean: 1.187955 2021-03-09 19:03:16.853: INFO @log_variables: train age_loss mean: 9.010799 2021-03-09 19:03:16.854: INFO @log_variables: train gender_loss mean: 0.265542 2021-03-09 19:03:16.854: INFO @log_variables: train age_mae mean: 8.445607 2021-03-09 19:03:16.854: INFO @log_variables: train gender_accuracy mean: 0.889323 2021-03-09 19:03:16.854: INFO @log_variables: train gender_confidence/loss nanmean: 0.068898 2021-03-09 19:03:16.854: INFO @log_variables: train gender_confidence/accuracy mean: 0.788556 2021-03-09 19:03:16.854: INFO @log_variables: train age_confidence/loss mean: 0.058492 2021-03-09 19:03:16.854: INFO @log_variables: train age_confidence/accuracy mean: 0.665292 2021-03-09 19:03:16.854: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:03:16.856: INFO @metrics_hook: train age_mae: 8.446 +-0.146 (13824) 2021-03-09 19:03:16.857: INFO @metrics_hook: train gender_accuracy: 0.889 +-0.005 (13824) 2021-03-09 19:03:19.385: INFO @decay_lr : LR updated to `7.8289995e-05` 2021-03-09 19:03:19.386: INFO @log_profile : T train: 18.378219 2021-03-09 19:03:19.386: INFO @log_profile : T read data: 0.360406 2021-03-09 19:03:19.386: INFO @log_profile : T hooks: 3.016192 2021-03-09 19:03:19.386: INFO @main_loop : Epoch 268 done 2021-03-09 19:03:19.386: INFO @main_loop : Training epoch 269 2021-03-09 19:03:40.485: INFO @log_variables: train loss nanmean: 1.183017 2021-03-09 19:03:40.485: INFO @log_variables: train age_loss mean: 8.992140 2021-03-09 19:03:40.485: INFO @log_variables: train gender_loss mean: 0.261255 2021-03-09 19:03:40.485: INFO @log_variables: train age_mae mean: 8.424951 2021-03-09 19:03:40.485: INFO @log_variables: train gender_accuracy mean: 0.892361 2021-03-09 19:03:40.485: INFO @log_variables: train gender_confidence/loss nanmean: 0.068889 2021-03-09 19:03:40.485: INFO @log_variables: train gender_confidence/accuracy mean: 0.787399 2021-03-09 19:03:40.485: INFO @log_variables: train age_confidence/loss mean: 0.059157 2021-03-09 19:03:40.486: INFO @log_variables: train age_confidence/accuracy mean: 0.658420 2021-03-09 19:03:40.486: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:03:40.488: INFO @metrics_hook: train age_mae: 8.425 +-0.146 (13824) 2021-03-09 19:03:40.490: INFO @metrics_hook: train gender_accuracy: 0.892 +-0.005 (13824) 2021-03-09 19:03:43.474: INFO @decay_lr : LR updated to `7.789855e-05` 2021-03-09 19:03:43.477: INFO @log_profile : T train: 19.854422 2021-03-09 19:03:43.477: INFO @log_profile : T read data: 0.671493 2021-03-09 19:03:43.477: INFO @log_profile : T hooks: 3.506082 2021-03-09 19:03:43.477: INFO @main_loop : Epoch 269 done 2021-03-09 19:03:43.477: INFO @main_loop : Training epoch 270 2021-03-09 19:04:05.323: INFO @log_variables: train loss nanmean: 1.180673 2021-03-09 19:04:05.323: INFO @log_variables: train age_loss mean: 8.998800 2021-03-09 19:04:05.323: INFO @log_variables: train gender_loss mean: 0.258597 2021-03-09 19:04:05.323: INFO @log_variables: train age_mae mean: 8.436302 2021-03-09 19:04:05.323: INFO @log_variables: train gender_accuracy mean: 0.891710 2021-03-09 19:04:05.323: INFO @log_variables: train gender_confidence/loss nanmean: 0.068837 2021-03-09 19:04:05.323: INFO @log_variables: train gender_confidence/accuracy mean: 0.788556 2021-03-09 19:04:05.323: INFO @log_variables: train age_confidence/loss mean: 0.058676 2021-03-09 19:04:05.324: INFO @log_variables: train age_confidence/accuracy mean: 0.666522 2021-03-09 19:04:05.324: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:04:05.326: INFO @metrics_hook: train age_mae: 8.436 +-0.147 (13824) 2021-03-09 19:04:05.330: INFO @metrics_hook: train gender_accuracy: 0.892 +-0.005 (13824) 2021-03-09 19:04:08.038: INFO @decay_lr : LR updated to `7.750906e-05` 2021-03-09 19:04:08.040: INFO @log_profile : T train: 20.653305 2021-03-09 19:04:08.041: INFO @log_profile : T read data: 0.607373 2021-03-09 19:04:08.041: INFO @log_profile : T hooks: 3.244591 2021-03-09 19:04:08.041: INFO @main_loop : Epoch 270 done 2021-03-09 19:04:08.041: INFO @main_loop : Training epoch 271 2021-03-09 19:04:30.523: INFO @log_variables: train loss nanmean: 1.167632 2021-03-09 19:04:30.523: INFO @log_variables: train age_loss mean: 8.808594 2021-03-09 19:04:30.523: INFO @log_variables: train gender_loss mean: 0.262762 2021-03-09 19:04:30.524: INFO @log_variables: train age_mae mean: 8.249741 2021-03-09 19:04:30.524: INFO @log_variables: train gender_accuracy mean: 0.889829 2021-03-09 19:04:30.524: INFO @log_variables: train gender_confidence/loss nanmean: 0.068435 2021-03-09 19:04:30.524: INFO @log_variables: train gender_confidence/accuracy mean: 0.782986 2021-03-09 19:04:30.524: INFO @log_variables: train age_confidence/loss mean: 0.059541 2021-03-09 19:04:30.524: INFO @log_variables: train age_confidence/accuracy mean: 0.654659 2021-03-09 19:04:30.525: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:04:30.527: INFO @metrics_hook: train age_mae: 8.250 +-0.142 (13824) 2021-03-09 19:04:30.531: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 19:04:33.571: INFO @decay_lr : LR updated to `7.712151e-05` 2021-03-09 19:04:33.578: INFO @log_profile : T train: 21.307572 2021-03-09 19:04:33.580: INFO @log_profile : T read data: 0.604880 2021-03-09 19:04:33.582: INFO @log_profile : T hooks: 3.564541 2021-03-09 19:04:33.585: INFO @main_loop : Epoch 271 done 2021-03-09 19:04:33.587: INFO @main_loop : Training epoch 272 2021-03-09 19:04:55.170: INFO @log_variables: train loss nanmean: 1.180559 2021-03-09 19:04:55.171: INFO @log_variables: train age_loss mean: 8.962220 2021-03-09 19:04:55.171: INFO @log_variables: train gender_loss mean: 0.261564 2021-03-09 19:04:55.171: INFO @log_variables: train age_mae mean: 8.399780 2021-03-09 19:04:55.171: INFO @log_variables: train gender_accuracy mean: 0.892940 2021-03-09 19:04:55.171: INFO @log_variables: train gender_confidence/loss nanmean: 0.069634 2021-03-09 19:04:55.171: INFO @log_variables: train gender_confidence/accuracy mean: 0.782769 2021-03-09 19:04:55.171: INFO @log_variables: train age_confidence/loss mean: 0.058392 2021-03-09 19:04:55.171: INFO @log_variables: train age_confidence/accuracy mean: 0.664280 2021-03-09 19:04:55.171: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:04:55.173: INFO @metrics_hook: train age_mae: 8.400 +-0.146 (13824) 2021-03-09 19:04:55.174: INFO @metrics_hook: train gender_accuracy: 0.893 +-0.005 (13824) 2021-03-09 19:04:58.015: INFO @decay_lr : LR updated to `7.67359e-05` 2021-03-09 19:04:58.021: INFO @log_profile : T train: 20.355873 2021-03-09 19:04:58.023: INFO @log_profile : T read data: 0.675517 2021-03-09 19:04:58.025: INFO @log_profile : T hooks: 3.342393 2021-03-09 19:04:58.027: INFO @main_loop : Epoch 272 done 2021-03-09 19:04:58.029: INFO @main_loop : Training epoch 273 2021-03-09 19:05:18.241: INFO @log_variables: train loss nanmean: 1.181875 2021-03-09 19:05:18.242: INFO @log_variables: train age_loss mean: 8.876912 2021-03-09 19:05:18.242: INFO @log_variables: train gender_loss mean: 0.270782 2021-03-09 19:05:18.242: INFO @log_variables: train age_mae mean: 8.314335 2021-03-09 19:05:18.242: INFO @log_variables: train gender_accuracy mean: 0.885489 2021-03-09 19:05:18.242: INFO @log_variables: train gender_confidence/loss nanmean: 0.069380 2021-03-09 19:05:18.242: INFO @log_variables: train gender_confidence/accuracy mean: 0.779442 2021-03-09 19:05:18.242: INFO @log_variables: train age_confidence/loss mean: 0.059338 2021-03-09 19:05:18.242: INFO @log_variables: train age_confidence/accuracy mean: 0.660156 2021-03-09 19:05:18.242: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:05:18.243: INFO @metrics_hook: train age_mae: 8.314 +-0.143 (13824) 2021-03-09 19:05:18.245: INFO @metrics_hook: train gender_accuracy: 0.885 +-0.005 (13824) 2021-03-09 19:05:20.520: INFO @decay_lr : LR updated to `7.635222e-05` 2021-03-09 19:05:20.522: INFO @log_profile : T train: 19.277422 2021-03-09 19:05:20.522: INFO @log_profile : T read data: 0.394355 2021-03-09 19:05:20.522: INFO @log_profile : T hooks: 2.767701 2021-03-09 19:05:20.522: INFO @main_loop : Epoch 273 done 2021-03-09 19:05:20.522: INFO @main_loop : Training epoch 274 2021-03-09 19:05:39.913: INFO @log_variables: train loss nanmean: 1.168836 2021-03-09 19:05:39.913: INFO @log_variables: train age_loss mean: 8.903892 2021-03-09 19:05:39.913: INFO @log_variables: train gender_loss mean: 0.256264 2021-03-09 19:05:39.913: INFO @log_variables: train age_mae mean: 8.346547 2021-03-09 19:05:39.913: INFO @log_variables: train gender_accuracy mean: 0.894459 2021-03-09 19:05:39.913: INFO @log_variables: train gender_confidence/loss nanmean: 0.067313 2021-03-09 19:05:39.914: INFO @log_variables: train gender_confidence/accuracy mean: 0.794199 2021-03-09 19:05:39.914: INFO @log_variables: train age_confidence/loss mean: 0.059110 2021-03-09 19:05:39.914: INFO @log_variables: train age_confidence/accuracy mean: 0.659795 2021-03-09 19:05:39.914: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:05:39.916: INFO @metrics_hook: train age_mae: 8.347 +-0.143 (13824) 2021-03-09 19:05:39.917: INFO @metrics_hook: train gender_accuracy: 0.894 +-0.005 (13824) 2021-03-09 19:05:42.161: INFO @decay_lr : LR updated to `7.5970456e-05` 2021-03-09 19:05:42.162: INFO @log_profile : T train: 18.528262 2021-03-09 19:05:42.162: INFO @log_profile : T read data: 0.327250 2021-03-09 19:05:42.163: INFO @log_profile : T hooks: 2.733633 2021-03-09 19:05:42.163: INFO @main_loop : Epoch 274 done 2021-03-09 19:05:42.163: INFO @main_loop : Training epoch 275 2021-03-09 19:06:01.345: INFO @log_variables: train loss nanmean: 1.196931 2021-03-09 19:06:01.346: INFO @log_variables: train age_loss mean: 9.105146 2021-03-09 19:06:01.346: INFO @log_variables: train gender_loss mean: 0.265372 2021-03-09 19:06:01.346: INFO @log_variables: train age_mae mean: 8.539430 2021-03-09 19:06:01.346: INFO @log_variables: train gender_accuracy mean: 0.889612 2021-03-09 19:06:01.346: INFO @log_variables: train gender_confidence/loss nanmean: 0.069534 2021-03-09 19:06:01.346: INFO @log_variables: train gender_confidence/accuracy mean: 0.781829 2021-03-09 19:06:01.346: INFO @log_variables: train age_confidence/loss mean: 0.058410 2021-03-09 19:06:01.346: INFO @log_variables: train age_confidence/accuracy mean: 0.670501 2021-03-09 19:06:01.346: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:06:01.348: INFO @metrics_hook: train age_mae: 8.539 +-0.147 (13824) 2021-03-09 19:06:01.350: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 19:06:03.472: INFO @decay_lr : LR updated to `7.559061e-05` 2021-03-09 19:06:03.474: INFO @log_profile : T train: 18.311975 2021-03-09 19:06:03.474: INFO @log_profile : T read data: 0.332646 2021-03-09 19:06:03.474: INFO @log_profile : T hooks: 2.616064 2021-03-09 19:06:03.474: INFO @main_loop : Epoch 275 done 2021-03-09 19:06:03.474: INFO @main_loop : Training epoch 276 2021-03-09 19:06:23.148: INFO @log_variables: train loss nanmean: 1.170185 2021-03-09 19:06:23.148: INFO @log_variables: train age_loss mean: 8.804279 2021-03-09 19:06:23.148: INFO @log_variables: train gender_loss mean: 0.265929 2021-03-09 19:06:23.148: INFO @log_variables: train age_mae mean: 8.246095 2021-03-09 19:06:23.148: INFO @log_variables: train gender_accuracy mean: 0.889323 2021-03-09 19:06:23.149: INFO @log_variables: train gender_confidence/loss nanmean: 0.068806 2021-03-09 19:06:23.149: INFO @log_variables: train gender_confidence/accuracy mean: 0.783348 2021-03-09 19:06:23.149: INFO @log_variables: train age_confidence/loss mean: 0.059236 2021-03-09 19:06:23.149: INFO @log_variables: train age_confidence/accuracy mean: 0.662037 2021-03-09 19:06:23.149: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:06:23.150: INFO @metrics_hook: train age_mae: 8.246 +-0.143 (13824) 2021-03-09 19:06:23.153: INFO @metrics_hook: train gender_accuracy: 0.889 +-0.005 (13824) 2021-03-09 19:06:25.568: INFO @decay_lr : LR updated to `7.521266e-05` 2021-03-09 19:06:25.570: INFO @log_profile : T train: 18.619688 2021-03-09 19:06:25.570: INFO @log_profile : T read data: 0.474851 2021-03-09 19:06:25.570: INFO @log_profile : T hooks: 2.946422 2021-03-09 19:06:25.570: INFO @main_loop : Epoch 276 done 2021-03-09 19:06:25.570: INFO @main_loop : Training epoch 277 2021-03-09 19:06:45.116: INFO @log_variables: train loss nanmean: 1.165742 2021-03-09 19:06:45.117: INFO @log_variables: train age_loss mean: 8.876405 2021-03-09 19:06:45.117: INFO @log_variables: train gender_loss mean: 0.254891 2021-03-09 19:06:45.117: INFO @log_variables: train age_mae mean: 8.317070 2021-03-09 19:06:45.117: INFO @log_variables: train gender_accuracy mean: 0.894813 2021-03-09 19:06:45.117: INFO @log_variables: train gender_confidence/loss nanmean: 0.068360 2021-03-09 19:06:45.117: INFO @log_variables: train gender_confidence/accuracy mean: 0.791724 2021-03-09 19:06:45.117: INFO @log_variables: train age_confidence/loss mean: 0.058717 2021-03-09 19:06:45.117: INFO @log_variables: train age_confidence/accuracy mean: 0.662953 2021-03-09 19:06:45.118: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:06:45.120: INFO @metrics_hook: train age_mae: 8.317 +-0.143 (13823) 2021-03-09 19:06:45.122: INFO @metrics_hook: train gender_accuracy: 0.895 +-0.005 (13823) 2021-03-09 19:06:52.064: INFO @decay_lr : LR updated to `7.483659e-05` 2021-03-09 19:06:52.068: INFO @log_profile : T train: 18.630486 2021-03-09 19:06:52.070: INFO @log_profile : T read data: 0.336030 2021-03-09 19:06:52.070: INFO @log_profile : T hooks: 7.479046 2021-03-09 19:06:52.070: INFO @main_loop : Epoch 277 done 2021-03-09 19:06:52.070: INFO @main_loop : Training epoch 278 2021-03-09 19:07:15.597: INFO @log_variables: train loss nanmean: 1.166484 2021-03-09 19:07:15.599: INFO @log_variables: train age_loss mean: 8.821403 2021-03-09 19:07:15.600: INFO @log_variables: train gender_loss mean: 0.260608 2021-03-09 19:07:15.603: INFO @log_variables: train age_mae mean: 8.263770 2021-03-09 19:07:15.605: INFO @log_variables: train gender_accuracy mean: 0.892868 2021-03-09 19:07:15.607: INFO @log_variables: train gender_confidence/loss nanmean: 0.068749 2021-03-09 19:07:15.610: INFO @log_variables: train gender_confidence/accuracy mean: 0.787833 2021-03-09 19:07:15.610: INFO @log_variables: train age_confidence/loss mean: 0.058873 2021-03-09 19:07:15.610: INFO @log_variables: train age_confidence/accuracy mean: 0.667679 2021-03-09 19:07:15.610: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:07:15.628: INFO @metrics_hook: train age_mae: 8.264 +-0.144 (13824) 2021-03-09 19:07:15.632: INFO @metrics_hook: train gender_accuracy: 0.893 +-0.005 (13824) 2021-03-09 19:07:19.034: INFO @decay_lr : LR updated to `7.446241e-05` 2021-03-09 19:07:19.037: INFO @log_profile : T train: 22.350947 2021-03-09 19:07:19.037: INFO @log_profile : T read data: 0.615235 2021-03-09 19:07:19.037: INFO @log_profile : T hooks: 3.935106 2021-03-09 19:07:19.037: INFO @main_loop : Epoch 278 done 2021-03-09 19:07:19.037: INFO @main_loop : Training epoch 279 2021-03-09 19:07:40.668: INFO @log_variables: train loss nanmean: 1.171532 2021-03-09 19:07:40.668: INFO @log_variables: train age_loss mean: 8.810025 2021-03-09 19:07:40.668: INFO @log_variables: train gender_loss mean: 0.265289 2021-03-09 19:07:40.668: INFO @log_variables: train age_mae mean: 8.254582 2021-03-09 19:07:40.668: INFO @log_variables: train gender_accuracy mean: 0.892072 2021-03-09 19:07:40.668: INFO @log_variables: train gender_confidence/loss nanmean: 0.070215 2021-03-09 19:07:40.668: INFO @log_variables: train gender_confidence/accuracy mean: 0.787760 2021-03-09 19:07:40.668: INFO @log_variables: train age_confidence/loss mean: 0.059234 2021-03-09 19:07:40.668: INFO @log_variables: train age_confidence/accuracy mean: 0.660084 2021-03-09 19:07:40.669: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:07:40.670: INFO @metrics_hook: train age_mae: 8.255 +-0.142 (13824) 2021-03-09 19:07:40.672: INFO @metrics_hook: train gender_accuracy: 0.892 +-0.005 (13824) 2021-03-09 19:07:43.727: INFO @decay_lr : LR updated to `7.40901e-05` 2021-03-09 19:07:43.733: INFO @log_profile : T train: 20.384092 2021-03-09 19:07:43.733: INFO @log_profile : T read data: 0.666580 2021-03-09 19:07:43.733: INFO @log_profile : T hooks: 3.574326 2021-03-09 19:07:43.733: INFO @main_loop : Epoch 279 done 2021-03-09 19:07:43.733: INFO @main_loop : Training epoch 280 2021-03-09 19:08:05.556: INFO @log_variables: train loss nanmean: 1.174854 2021-03-09 19:08:05.562: INFO @log_variables: train age_loss mean: 8.976274 2021-03-09 19:08:05.562: INFO @log_variables: train gender_loss mean: 0.256026 2021-03-09 19:08:05.562: INFO @log_variables: train age_mae mean: 8.416477 2021-03-09 19:08:05.562: INFO @log_variables: train gender_accuracy mean: 0.892795 2021-03-09 19:08:05.562: INFO @log_variables: train gender_confidence/loss nanmean: 0.067349 2021-03-09 19:08:05.562: INFO @log_variables: train gender_confidence/accuracy mean: 0.796441 2021-03-09 19:08:05.562: INFO @log_variables: train age_confidence/loss mean: 0.058729 2021-03-09 19:08:05.562: INFO @log_variables: train age_confidence/accuracy mean: 0.666377 2021-03-09 19:08:05.562: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:08:05.565: INFO @metrics_hook: train age_mae: 8.416 +-0.148 (13824) 2021-03-09 19:08:05.571: INFO @metrics_hook: train gender_accuracy: 0.893 +-0.005 (13824) 2021-03-09 19:08:08.951: INFO @decay_lr : LR updated to `7.371965e-05` 2021-03-09 19:08:08.953: INFO @log_profile : T train: 20.664386 2021-03-09 19:08:08.953: INFO @log_profile : T read data: 0.539418 2021-03-09 19:08:08.953: INFO @log_profile : T hooks: 3.955253 2021-03-09 19:08:08.954: INFO @main_loop : Epoch 280 done 2021-03-09 19:08:08.954: INFO @main_loop : Training epoch 281 2021-03-09 19:08:30.024: INFO @log_variables: train loss nanmean: 1.162465 2021-03-09 19:08:30.025: INFO @log_variables: train age_loss mean: 8.820948 2021-03-09 19:08:30.025: INFO @log_variables: train gender_loss mean: 0.256536 2021-03-09 19:08:30.025: INFO @log_variables: train age_mae mean: 8.264792 2021-03-09 19:08:30.025: INFO @log_variables: train gender_accuracy mean: 0.892795 2021-03-09 19:08:30.025: INFO @log_variables: train gender_confidence/loss nanmean: 0.068338 2021-03-09 19:08:30.025: INFO @log_variables: train gender_confidence/accuracy mean: 0.791233 2021-03-09 19:08:30.025: INFO @log_variables: train age_confidence/loss mean: 0.059008 2021-03-09 19:08:30.025: INFO @log_variables: train age_confidence/accuracy mean: 0.665148 2021-03-09 19:08:30.025: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:08:30.027: INFO @metrics_hook: train age_mae: 8.265 +-0.143 (13824) 2021-03-09 19:08:30.029: INFO @metrics_hook: train gender_accuracy: 0.893 +-0.005 (13824) 2021-03-09 19:08:32.813: INFO @decay_lr : LR updated to `7.335105e-05` 2021-03-09 19:08:32.814: INFO @log_profile : T train: 20.012203 2021-03-09 19:08:32.815: INFO @log_profile : T read data: 0.482875 2021-03-09 19:08:32.815: INFO @log_profile : T hooks: 3.309641 2021-03-09 19:08:32.815: INFO @main_loop : Epoch 281 done 2021-03-09 19:08:32.815: INFO @main_loop : Training epoch 282 2021-03-09 19:08:52.055: INFO @log_variables: train loss nanmean: 1.168243 2021-03-09 19:08:52.055: INFO @log_variables: train age_loss mean: 8.921606 2021-03-09 19:08:52.055: INFO @log_variables: train gender_loss mean: 0.254165 2021-03-09 19:08:52.055: INFO @log_variables: train age_mae mean: 8.362804 2021-03-09 19:08:52.055: INFO @log_variables: train gender_accuracy mean: 0.892506 2021-03-09 19:08:52.055: INFO @log_variables: train gender_confidence/loss nanmean: 0.067628 2021-03-09 19:08:52.055: INFO @log_variables: train gender_confidence/accuracy mean: 0.784650 2021-03-09 19:08:52.055: INFO @log_variables: train age_confidence/loss mean: 0.058501 2021-03-09 19:08:52.056: INFO @log_variables: train age_confidence/accuracy mean: 0.665799 2021-03-09 19:08:52.056: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:08:52.058: INFO @metrics_hook: train age_mae: 8.363 +-0.145 (13824) 2021-03-09 19:08:52.060: INFO @metrics_hook: train gender_accuracy: 0.893 +-0.005 (13824) 2021-03-09 19:08:54.753: INFO @decay_lr : LR updated to `7.29843e-05` 2021-03-09 19:08:54.755: INFO @log_profile : T train: 18.173565 2021-03-09 19:08:54.755: INFO @log_profile : T read data: 0.504191 2021-03-09 19:08:54.755: INFO @log_profile : T hooks: 3.205807 2021-03-09 19:08:54.755: INFO @main_loop : Epoch 282 done 2021-03-09 19:08:54.755: INFO @main_loop : Training epoch 283 2021-03-09 19:09:13.572: INFO @log_variables: train loss nanmean: 1.172515 2021-03-09 19:09:13.572: INFO @log_variables: train age_loss mean: 8.856126 2021-03-09 19:09:13.572: INFO @log_variables: train gender_loss mean: 0.264637 2021-03-09 19:09:13.572: INFO @log_variables: train age_mae mean: 8.298959 2021-03-09 19:09:13.572: INFO @log_variables: train gender_accuracy mean: 0.890408 2021-03-09 19:09:13.572: INFO @log_variables: train gender_confidence/loss nanmean: 0.068705 2021-03-09 19:09:13.572: INFO @log_variables: train gender_confidence/accuracy mean: 0.786675 2021-03-09 19:09:13.572: INFO @log_variables: train age_confidence/loss mean: 0.058129 2021-03-09 19:09:13.572: INFO @log_variables: train age_confidence/accuracy mean: 0.673828 2021-03-09 19:09:13.573: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:09:13.574: INFO @metrics_hook: train age_mae: 8.299 +-0.144 (13824) 2021-03-09 19:09:13.577: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 19:09:16.030: INFO @decay_lr : LR updated to `7.261938e-05` 2021-03-09 19:09:16.032: INFO @log_profile : T train: 17.898243 2021-03-09 19:09:16.032: INFO @log_profile : T read data: 0.367393 2021-03-09 19:09:16.032: INFO @log_profile : T hooks: 2.957493 2021-03-09 19:09:16.032: INFO @main_loop : Epoch 283 done 2021-03-09 19:09:16.032: INFO @main_loop : Training epoch 284 2021-03-09 19:09:34.895: INFO @log_variables: train loss nanmean: 1.157326 2021-03-09 19:09:34.895: INFO @log_variables: train age_loss mean: 8.760787 2021-03-09 19:09:34.895: INFO @log_variables: train gender_loss mean: 0.256739 2021-03-09 19:09:34.895: INFO @log_variables: train age_mae mean: 8.206845 2021-03-09 19:09:34.895: INFO @log_variables: train gender_accuracy mean: 0.892209 2021-03-09 19:09:34.895: INFO @log_variables: train gender_confidence/loss nanmean: 0.067377 2021-03-09 19:09:34.895: INFO @log_variables: train gender_confidence/accuracy mean: 0.790422 2021-03-09 19:09:34.895: INFO @log_variables: train age_confidence/loss mean: 0.060115 2021-03-09 19:09:34.896: INFO @log_variables: train age_confidence/accuracy mean: 0.659625 2021-03-09 19:09:34.896: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:09:34.898: INFO @metrics_hook: train age_mae: 8.207 +-0.143 (13823) 2021-03-09 19:09:34.899: INFO @metrics_hook: train gender_accuracy: 0.892 +-0.005 (13823) 2021-03-09 19:09:37.367: INFO @decay_lr : LR updated to `7.225628e-05` 2021-03-09 19:09:37.369: INFO @log_profile : T train: 17.926502 2021-03-09 19:09:37.369: INFO @log_profile : T read data: 0.384158 2021-03-09 19:09:37.369: INFO @log_profile : T hooks: 2.971782 2021-03-09 19:09:37.369: INFO @main_loop : Epoch 284 done 2021-03-09 19:09:37.369: INFO @main_loop : Training epoch 285 2021-03-09 19:09:56.271: INFO @log_variables: train loss nanmean: 1.160760 2021-03-09 19:09:56.272: INFO @log_variables: train age_loss mean: 8.801660 2021-03-09 19:09:56.272: INFO @log_variables: train gender_loss mean: 0.257185 2021-03-09 19:09:56.272: INFO @log_variables: train age_mae mean: 8.246316 2021-03-09 19:09:56.272: INFO @log_variables: train gender_accuracy mean: 0.890480 2021-03-09 19:09:56.272: INFO @log_variables: train gender_confidence/loss nanmean: 0.067448 2021-03-09 19:09:56.272: INFO @log_variables: train gender_confidence/accuracy mean: 0.793620 2021-03-09 19:09:56.272: INFO @log_variables: train age_confidence/loss mean: 0.059357 2021-03-09 19:09:56.272: INFO @log_variables: train age_confidence/accuracy mean: 0.662616 2021-03-09 19:09:56.272: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:09:56.273: INFO @metrics_hook: train age_mae: 8.246 +-0.147 (13824) 2021-03-09 19:09:56.275: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 19:09:58.347: INFO @decay_lr : LR updated to `7.1895e-05` 2021-03-09 19:09:58.349: INFO @log_profile : T train: 17.854140 2021-03-09 19:09:58.349: INFO @log_profile : T read data: 0.469462 2021-03-09 19:09:58.349: INFO @log_profile : T hooks: 2.603795 2021-03-09 19:09:58.349: INFO @main_loop : Epoch 285 done 2021-03-09 19:09:58.349: INFO @main_loop : Training epoch 286 2021-03-09 19:10:16.532: INFO @log_variables: train loss nanmean: 1.159600 2021-03-09 19:10:16.532: INFO @log_variables: train age_loss mean: 8.745775 2021-03-09 19:10:16.532: INFO @log_variables: train gender_loss mean: 0.260049 2021-03-09 19:10:16.533: INFO @log_variables: train age_mae mean: 8.189534 2021-03-09 19:10:16.533: INFO @log_variables: train gender_accuracy mean: 0.893301 2021-03-09 19:10:16.533: INFO @log_variables: train gender_confidence/loss nanmean: 0.068923 2021-03-09 19:10:16.533: INFO @log_variables: train gender_confidence/accuracy mean: 0.786169 2021-03-09 19:10:16.533: INFO @log_variables: train age_confidence/loss mean: 0.059199 2021-03-09 19:10:16.533: INFO @log_variables: train age_confidence/accuracy mean: 0.664062 2021-03-09 19:10:16.533: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:10:16.535: INFO @metrics_hook: train age_mae: 8.190 +-0.141 (13824) 2021-03-09 19:10:16.537: INFO @metrics_hook: train gender_accuracy: 0.893 +-0.005 (13824) 2021-03-09 19:10:18.954: INFO @decay_lr : LR updated to `7.153553e-05` 2021-03-09 19:10:18.956: INFO @log_profile : T train: 17.324337 2021-03-09 19:10:18.956: INFO @log_profile : T read data: 0.318192 2021-03-09 19:10:18.956: INFO @log_profile : T hooks: 2.914776 2021-03-09 19:10:18.956: INFO @main_loop : Epoch 286 done 2021-03-09 19:10:18.956: INFO @main_loop : Training epoch 287 2021-03-09 19:10:38.425: INFO @log_variables: train loss nanmean: 1.156145 2021-03-09 19:10:38.425: INFO @log_variables: train age_loss mean: 8.678650 2021-03-09 19:10:38.426: INFO @log_variables: train gender_loss mean: 0.264278 2021-03-09 19:10:38.426: INFO @log_variables: train age_mae mean: 8.125923 2021-03-09 19:10:38.426: INFO @log_variables: train gender_accuracy mean: 0.889829 2021-03-09 19:10:38.426: INFO @log_variables: train gender_confidence/loss nanmean: 0.067314 2021-03-09 19:10:38.426: INFO @log_variables: train gender_confidence/accuracy mean: 0.792752 2021-03-09 19:10:38.426: INFO @log_variables: train age_confidence/loss mean: 0.059610 2021-03-09 19:10:38.426: INFO @log_variables: train age_confidence/accuracy mean: 0.661965 2021-03-09 19:10:38.426: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:10:38.429: INFO @metrics_hook: train age_mae: 8.126 +-0.141 (13824) 2021-03-09 19:10:38.431: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 19:10:40.734: INFO @decay_lr : LR updated to `7.117785e-05` 2021-03-09 19:10:40.738: INFO @log_profile : T train: 18.536529 2021-03-09 19:10:40.738: INFO @log_profile : T read data: 0.380911 2021-03-09 19:10:40.738: INFO @log_profile : T hooks: 2.809659 2021-03-09 19:10:40.738: INFO @main_loop : Epoch 287 done 2021-03-09 19:10:40.738: INFO @main_loop : Training epoch 288 2021-03-09 19:11:00.849: INFO @log_variables: train loss nanmean: 1.169529 2021-03-09 19:11:00.849: INFO @log_variables: train age_loss mean: 8.872316 2021-03-09 19:11:00.849: INFO @log_variables: train gender_loss mean: 0.260926 2021-03-09 19:11:00.849: INFO @log_variables: train age_mae mean: 8.316613 2021-03-09 19:11:00.849: INFO @log_variables: train gender_accuracy mean: 0.889540 2021-03-09 19:11:00.850: INFO @log_variables: train gender_confidence/loss nanmean: 0.067397 2021-03-09 19:11:00.850: INFO @log_variables: train gender_confidence/accuracy mean: 0.788918 2021-03-09 19:11:00.850: INFO @log_variables: train age_confidence/loss mean: 0.058353 2021-03-09 19:11:00.850: INFO @log_variables: train age_confidence/accuracy mean: 0.674045 2021-03-09 19:11:00.850: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:11:00.852: INFO @metrics_hook: train age_mae: 8.317 +-0.143 (13824) 2021-03-09 19:11:00.853: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 19:11:03.422: INFO @decay_lr : LR updated to `7.082196e-05` 2021-03-09 19:11:03.424: INFO @log_profile : T train: 19.043592 2021-03-09 19:11:03.424: INFO @log_profile : T read data: 0.541722 2021-03-09 19:11:03.424: INFO @log_profile : T hooks: 3.048023 2021-03-09 19:11:03.424: INFO @main_loop : Epoch 288 done 2021-03-09 19:11:03.424: INFO @main_loop : Training epoch 289 2021-03-09 19:11:23.274: INFO @log_variables: train loss nanmean: 1.165226 2021-03-09 19:11:23.274: INFO @log_variables: train age_loss mean: 8.831173 2021-03-09 19:11:23.274: INFO @log_variables: train gender_loss mean: 0.258259 2021-03-09 19:11:23.274: INFO @log_variables: train age_mae mean: 8.273315 2021-03-09 19:11:23.274: INFO @log_variables: train gender_accuracy mean: 0.893808 2021-03-09 19:11:23.274: INFO @log_variables: train gender_confidence/loss nanmean: 0.068796 2021-03-09 19:11:23.274: INFO @log_variables: train gender_confidence/accuracy mean: 0.786169 2021-03-09 19:11:23.274: INFO @log_variables: train age_confidence/loss mean: 0.058815 2021-03-09 19:11:23.274: INFO @log_variables: train age_confidence/accuracy mean: 0.665726 2021-03-09 19:11:23.275: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:11:23.276: INFO @metrics_hook: train age_mae: 8.273 +-0.145 (13824) 2021-03-09 19:11:23.277: INFO @metrics_hook: train gender_accuracy: 0.894 +-0.005 (13824) 2021-03-09 19:11:25.864: INFO @decay_lr : LR updated to `7.046785e-05` 2021-03-09 19:11:25.865: INFO @log_profile : T train: 18.945945 2021-03-09 19:11:25.866: INFO @log_profile : T read data: 0.391172 2021-03-09 19:11:25.866: INFO @log_profile : T hooks: 3.052686 2021-03-09 19:11:25.866: INFO @main_loop : Epoch 289 done 2021-03-09 19:11:25.866: INFO @main_loop : Training epoch 290 2021-03-09 19:11:45.198: INFO @log_variables: train loss nanmean: 1.155913 2021-03-09 19:11:45.198: INFO @log_variables: train age_loss mean: 8.773661 2021-03-09 19:11:45.198: INFO @log_variables: train gender_loss mean: 0.254506 2021-03-09 19:11:45.198: INFO @log_variables: train age_mae mean: 8.217222 2021-03-09 19:11:45.198: INFO @log_variables: train gender_accuracy mean: 0.893880 2021-03-09 19:11:45.198: INFO @log_variables: train gender_confidence/loss nanmean: 0.067574 2021-03-09 19:11:45.199: INFO @log_variables: train gender_confidence/accuracy mean: 0.794343 2021-03-09 19:11:45.199: INFO @log_variables: train age_confidence/loss mean: 0.059364 2021-03-09 19:11:45.199: INFO @log_variables: train age_confidence/accuracy mean: 0.663773 2021-03-09 19:11:45.199: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:11:45.201: INFO @metrics_hook: train age_mae: 8.217 +-0.143 (13824) 2021-03-09 19:11:45.203: INFO @metrics_hook: train gender_accuracy: 0.894 +-0.005 (13824) 2021-03-09 19:11:47.307: INFO @decay_lr : LR updated to `7.0115515e-05` 2021-03-09 19:11:47.308: INFO @log_profile : T train: 18.439012 2021-03-09 19:11:47.308: INFO @log_profile : T read data: 0.327721 2021-03-09 19:11:47.308: INFO @log_profile : T hooks: 2.623973 2021-03-09 19:11:47.308: INFO @main_loop : Epoch 290 done 2021-03-09 19:11:47.308: INFO @main_loop : Training epoch 291 2021-03-09 19:12:06.342: INFO @log_variables: train loss nanmean: 1.169269 2021-03-09 19:12:06.342: INFO @log_variables: train age_loss mean: 8.836045 2021-03-09 19:12:06.342: INFO @log_variables: train gender_loss mean: 0.261556 2021-03-09 19:12:06.342: INFO @log_variables: train age_mae mean: 8.275964 2021-03-09 19:12:06.342: INFO @log_variables: train gender_accuracy mean: 0.890987 2021-03-09 19:12:06.342: INFO @log_variables: train gender_confidence/loss nanmean: 0.068595 2021-03-09 19:12:06.342: INFO @log_variables: train gender_confidence/accuracy mean: 0.790148 2021-03-09 19:12:06.342: INFO @log_variables: train age_confidence/loss mean: 0.059620 2021-03-09 19:12:06.342: INFO @log_variables: train age_confidence/accuracy mean: 0.657263 2021-03-09 19:12:06.343: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:12:06.344: INFO @metrics_hook: train age_mae: 8.276 +-0.144 (13824) 2021-03-09 19:12:06.347: INFO @metrics_hook: train gender_accuracy: 0.891 +-0.005 (13824) 2021-03-09 19:12:08.354: INFO @decay_lr : LR updated to `6.976494e-05` 2021-03-09 19:12:08.355: INFO @log_profile : T train: 18.145776 2021-03-09 19:12:08.355: INFO @log_profile : T read data: 0.324404 2021-03-09 19:12:08.355: INFO @log_profile : T hooks: 2.527329 2021-03-09 19:12:08.355: INFO @main_loop : Epoch 291 done 2021-03-09 19:12:08.355: INFO @main_loop : Training epoch 292 2021-03-09 19:12:27.395: INFO @log_variables: train loss nanmean: 1.147420 2021-03-09 19:12:27.395: INFO @log_variables: train age_loss mean: 8.616888 2021-03-09 19:12:27.395: INFO @log_variables: train gender_loss mean: 0.258588 2021-03-09 19:12:27.395: INFO @log_variables: train age_mae mean: 8.066609 2021-03-09 19:12:27.396: INFO @log_variables: train gender_accuracy mean: 0.892072 2021-03-09 19:12:27.396: INFO @log_variables: train gender_confidence/loss nanmean: 0.069307 2021-03-09 19:12:27.396: INFO @log_variables: train gender_confidence/accuracy mean: 0.786603 2021-03-09 19:12:27.396: INFO @log_variables: train age_confidence/loss mean: 0.059680 2021-03-09 19:12:27.396: INFO @log_variables: train age_confidence/accuracy mean: 0.665437 2021-03-09 19:12:27.396: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:12:27.398: INFO @metrics_hook: train age_mae: 8.067 +-0.141 (13824) 2021-03-09 19:12:27.400: INFO @metrics_hook: train gender_accuracy: 0.892 +-0.005 (13824) 2021-03-09 19:12:29.469: INFO @decay_lr : LR updated to `6.941611e-05` 2021-03-09 19:12:29.471: INFO @log_profile : T train: 18.015038 2021-03-09 19:12:29.471: INFO @log_profile : T read data: 0.465534 2021-03-09 19:12:29.471: INFO @log_profile : T hooks: 2.584468 2021-03-09 19:12:29.471: INFO @main_loop : Epoch 292 done 2021-03-09 19:12:29.471: INFO @main_loop : Training epoch 293 2021-03-09 19:12:48.024: INFO @log_variables: train loss nanmean: 1.162709 2021-03-09 19:12:48.025: INFO @log_variables: train age_loss mean: 8.834260 2021-03-09 19:12:48.025: INFO @log_variables: train gender_loss mean: 0.256362 2021-03-09 19:12:48.025: INFO @log_variables: train age_mae mean: 8.277654 2021-03-09 19:12:48.025: INFO @log_variables: train gender_accuracy mean: 0.893736 2021-03-09 19:12:48.025: INFO @log_variables: train gender_confidence/loss nanmean: 0.066891 2021-03-09 19:12:48.025: INFO @log_variables: train gender_confidence/accuracy mean: 0.794054 2021-03-09 19:12:48.025: INFO @log_variables: train age_confidence/loss mean: 0.059648 2021-03-09 19:12:48.025: INFO @log_variables: train age_confidence/accuracy mean: 0.659361 2021-03-09 19:12:48.025: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:12:48.026: INFO @metrics_hook: train age_mae: 8.278 +-0.145 (13824) 2021-03-09 19:12:48.027: INFO @metrics_hook: train gender_accuracy: 0.894 +-0.005 (13824) 2021-03-09 19:12:50.007: INFO @decay_lr : LR updated to `6.9069036e-05` 2021-03-09 19:12:50.009: INFO @log_profile : T train: 17.703311 2021-03-09 19:12:50.009: INFO @log_profile : T read data: 0.308616 2021-03-09 19:12:50.009: INFO @log_profile : T hooks: 2.477051 2021-03-09 19:12:50.009: INFO @main_loop : Epoch 293 done 2021-03-09 19:12:50.009: INFO @main_loop : Training epoch 294 2021-03-09 19:13:09.414: INFO @log_variables: train loss nanmean: 1.152473 2021-03-09 19:13:09.416: INFO @log_variables: train age_loss mean: 8.637114 2021-03-09 19:13:09.417: INFO @log_variables: train gender_loss mean: 0.262002 2021-03-09 19:13:09.417: INFO @log_variables: train age_mae mean: 8.084557 2021-03-09 19:13:09.417: INFO @log_variables: train gender_accuracy mean: 0.891059 2021-03-09 19:13:09.417: INFO @log_variables: train gender_confidence/loss nanmean: 0.069129 2021-03-09 19:13:09.417: INFO @log_variables: train gender_confidence/accuracy mean: 0.784578 2021-03-09 19:13:09.417: INFO @log_variables: train age_confidence/loss mean: 0.059969 2021-03-09 19:13:09.417: INFO @log_variables: train age_confidence/accuracy mean: 0.658348 2021-03-09 19:13:09.417: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:13:09.419: INFO @metrics_hook: train age_mae: 8.085 +-0.140 (13824) 2021-03-09 19:13:09.421: INFO @metrics_hook: train gender_accuracy: 0.891 +-0.005 (13824) 2021-03-09 19:13:12.305: INFO @decay_lr : LR updated to `6.872369e-05` 2021-03-09 19:13:12.307: INFO @log_profile : T train: 18.512640 2021-03-09 19:13:12.307: INFO @log_profile : T read data: 0.362546 2021-03-09 19:13:12.307: INFO @log_profile : T hooks: 3.370595 2021-03-09 19:13:12.307: INFO @main_loop : Epoch 294 done 2021-03-09 19:13:12.307: INFO @main_loop : Training epoch 295 2021-03-09 19:13:33.136: INFO @log_variables: train loss nanmean: 1.149645 2021-03-09 19:13:33.136: INFO @log_variables: train age_loss mean: 8.691908 2021-03-09 19:13:33.136: INFO @log_variables: train gender_loss mean: 0.255515 2021-03-09 19:13:33.136: INFO @log_variables: train age_mae mean: 8.138869 2021-03-09 19:13:33.136: INFO @log_variables: train gender_accuracy mean: 0.892506 2021-03-09 19:13:33.136: INFO @log_variables: train gender_confidence/loss nanmean: 0.068143 2021-03-09 19:13:33.136: INFO @log_variables: train gender_confidence/accuracy mean: 0.791160 2021-03-09 19:13:33.136: INFO @log_variables: train age_confidence/loss mean: 0.059042 2021-03-09 19:13:33.136: INFO @log_variables: train age_confidence/accuracy mean: 0.660084 2021-03-09 19:13:33.136: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:13:33.140: INFO @metrics_hook: train age_mae: 8.139 +-0.139 (13824) 2021-03-09 19:13:33.144: INFO @metrics_hook: train gender_accuracy: 0.893 +-0.005 (13824) 2021-03-09 19:13:36.111: INFO @decay_lr : LR updated to `6.838007e-05` 2021-03-09 19:13:36.116: INFO @log_profile : T train: 19.571173 2021-03-09 19:13:36.116: INFO @log_profile : T read data: 0.688460 2021-03-09 19:13:36.117: INFO @log_profile : T hooks: 3.487345 2021-03-09 19:13:36.117: INFO @main_loop : Epoch 295 done 2021-03-09 19:13:36.117: INFO @main_loop : Training epoch 296 2021-03-09 19:13:57.171: INFO @log_variables: train loss nanmean: 1.162770 2021-03-09 19:13:57.171: INFO @log_variables: train age_loss mean: 8.745507 2021-03-09 19:13:57.171: INFO @log_variables: train gender_loss mean: 0.262727 2021-03-09 19:13:57.171: INFO @log_variables: train age_mae mean: 8.190072 2021-03-09 19:13:57.171: INFO @log_variables: train gender_accuracy mean: 0.890914 2021-03-09 19:13:57.171: INFO @log_variables: train gender_confidence/loss nanmean: 0.069550 2021-03-09 19:13:57.171: INFO @log_variables: train gender_confidence/accuracy mean: 0.785807 2021-03-09 19:13:57.171: INFO @log_variables: train age_confidence/loss mean: 0.059331 2021-03-09 19:13:57.173: INFO @log_variables: train age_confidence/accuracy mean: 0.660735 2021-03-09 19:13:57.173: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:13:57.175: INFO @metrics_hook: train age_mae: 8.190 +-0.143 (13824) 2021-03-09 19:13:57.176: INFO @metrics_hook: train gender_accuracy: 0.891 +-0.005 (13824) 2021-03-09 19:14:00.118: INFO @decay_lr : LR updated to `6.803817e-05` 2021-03-09 19:14:00.122: INFO @log_profile : T train: 19.963133 2021-03-09 19:14:00.122: INFO @log_profile : T read data: 0.534439 2021-03-09 19:14:00.122: INFO @log_profile : T hooks: 3.449848 2021-03-09 19:14:00.122: INFO @main_loop : Epoch 296 done 2021-03-09 19:14:00.122: INFO @main_loop : Training epoch 297 2021-03-09 19:14:21.073: INFO @log_variables: train loss nanmean: 1.167241 2021-03-09 19:14:21.075: INFO @log_variables: train age_loss mean: 8.816863 2021-03-09 19:14:21.075: INFO @log_variables: train gender_loss mean: 0.263462 2021-03-09 19:14:21.076: INFO @log_variables: train age_mae mean: 8.261486 2021-03-09 19:14:21.076: INFO @log_variables: train gender_accuracy mean: 0.890697 2021-03-09 19:14:21.076: INFO @log_variables: train gender_confidence/loss nanmean: 0.067771 2021-03-09 19:14:21.076: INFO @log_variables: train gender_confidence/accuracy mean: 0.785229 2021-03-09 19:14:21.076: INFO @log_variables: train age_confidence/loss mean: 0.058427 2021-03-09 19:14:21.076: INFO @log_variables: train age_confidence/accuracy mean: 0.670067 2021-03-09 19:14:21.076: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:14:21.078: INFO @metrics_hook: train age_mae: 8.261 +-0.143 (13824) 2021-03-09 19:14:21.080: INFO @metrics_hook: train gender_accuracy: 0.891 +-0.005 (13824) 2021-03-09 19:14:24.037: INFO @decay_lr : LR updated to `6.769798e-05` 2021-03-09 19:14:24.041: INFO @log_profile : T train: 19.891546 2021-03-09 19:14:24.041: INFO @log_profile : T read data: 0.482669 2021-03-09 19:14:24.041: INFO @log_profile : T hooks: 3.487774 2021-03-09 19:14:24.041: INFO @main_loop : Epoch 297 done 2021-03-09 19:14:24.041: INFO @main_loop : Training epoch 298 2021-03-09 19:14:45.313: INFO @log_variables: train loss nanmean: 1.163154 2021-03-09 19:14:45.313: INFO @log_variables: train age_loss mean: 8.761530 2021-03-09 19:14:45.313: INFO @log_variables: train gender_loss mean: 0.262486 2021-03-09 19:14:45.313: INFO @log_variables: train age_mae mean: 8.205876 2021-03-09 19:14:45.313: INFO @log_variables: train gender_accuracy mean: 0.891348 2021-03-09 19:14:45.313: INFO @log_variables: train gender_confidence/loss nanmean: 0.069089 2021-03-09 19:14:45.313: INFO @log_variables: train gender_confidence/accuracy mean: 0.787905 2021-03-09 19:14:45.314: INFO @log_variables: train age_confidence/loss mean: 0.058939 2021-03-09 19:14:45.314: INFO @log_variables: train age_confidence/accuracy mean: 0.667824 2021-03-09 19:14:45.314: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:14:45.316: INFO @metrics_hook: train age_mae: 8.206 +-0.140 (13824) 2021-03-09 19:14:45.317: INFO @metrics_hook: train gender_accuracy: 0.891 +-0.005 (13824) 2021-03-09 19:14:47.430: INFO @decay_lr : LR updated to `6.735949e-05` 2021-03-09 19:14:47.431: INFO @log_profile : T train: 20.063317 2021-03-09 19:14:47.431: INFO @log_profile : T read data: 0.664655 2021-03-09 19:14:47.431: INFO @log_profile : T hooks: 2.607665 2021-03-09 19:14:47.431: INFO @main_loop : Epoch 298 done 2021-03-09 19:14:47.431: INFO @main_loop : Training epoch 299 2021-03-09 19:15:06.621: INFO @log_variables: train loss nanmean: 1.169553 2021-03-09 19:15:06.621: INFO @log_variables: train age_loss mean: 8.872622 2021-03-09 19:15:06.621: INFO @log_variables: train gender_loss mean: 0.258847 2021-03-09 19:15:06.621: INFO @log_variables: train age_mae mean: 8.315715 2021-03-09 19:15:06.621: INFO @log_variables: train gender_accuracy mean: 0.893229 2021-03-09 19:15:06.622: INFO @log_variables: train gender_confidence/loss nanmean: 0.068648 2021-03-09 19:15:06.622: INFO @log_variables: train gender_confidence/accuracy mean: 0.785735 2021-03-09 19:15:06.622: INFO @log_variables: train age_confidence/loss mean: 0.058988 2021-03-09 19:15:06.622: INFO @log_variables: train age_confidence/accuracy mean: 0.666233 2021-03-09 19:15:06.622: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:15:06.624: INFO @metrics_hook: train age_mae: 8.316 +-0.143 (13824) 2021-03-09 19:15:06.626: INFO @metrics_hook: train gender_accuracy: 0.893 +-0.005 (13824) 2021-03-09 19:15:08.797: INFO @decay_lr : LR updated to `6.7022695e-05` 2021-03-09 19:15:08.799: INFO @log_profile : T train: 18.306066 2021-03-09 19:15:08.799: INFO @log_profile : T read data: 0.330032 2021-03-09 19:15:08.799: INFO @log_profile : T hooks: 2.678412 2021-03-09 19:15:08.799: INFO @main_loop : Epoch 299 done 2021-03-09 19:15:08.799: INFO @main_loop : Training epoch 300 2021-03-09 19:15:28.006: INFO @log_variables: train loss nanmean: 1.159014 2021-03-09 19:15:28.007: INFO @log_variables: train age_loss mean: 8.779173 2021-03-09 19:15:28.007: INFO @log_variables: train gender_loss mean: 0.256657 2021-03-09 19:15:28.007: INFO @log_variables: train age_mae mean: 8.226290 2021-03-09 19:15:28.007: INFO @log_variables: train gender_accuracy mean: 0.893446 2021-03-09 19:15:28.007: INFO @log_variables: train gender_confidence/loss nanmean: 0.068069 2021-03-09 19:15:28.007: INFO @log_variables: train gender_confidence/accuracy mean: 0.793186 2021-03-09 19:15:28.007: INFO @log_variables: train age_confidence/loss mean: 0.059514 2021-03-09 19:15:28.007: INFO @log_variables: train age_confidence/accuracy mean: 0.666594 2021-03-09 19:15:28.008: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:15:28.010: INFO @metrics_hook: train age_mae: 8.226 +-0.145 (13824) 2021-03-09 19:15:28.013: INFO @metrics_hook: train gender_accuracy: 0.893 +-0.005 (13824) 2021-03-09 19:15:30.172: INFO @decay_lr : LR updated to `6.668758e-05` 2021-03-09 19:15:30.174: INFO @log_profile : T train: 18.327526 2021-03-09 19:15:30.174: INFO @log_profile : T read data: 0.339399 2021-03-09 19:15:30.174: INFO @log_profile : T hooks: 2.656116 2021-03-09 19:15:30.174: INFO @main_loop : Epoch 300 done 2021-03-09 19:15:30.174: INFO @main_loop : Training epoch 301 2021-03-09 19:15:49.500: INFO @log_variables: train loss nanmean: 1.156446 2021-03-09 19:15:49.501: INFO @log_variables: train age_loss mean: 8.706783 2021-03-09 19:15:49.501: INFO @log_variables: train gender_loss mean: 0.261667 2021-03-09 19:15:49.501: INFO @log_variables: train age_mae mean: 8.149410 2021-03-09 19:15:49.501: INFO @log_variables: train gender_accuracy mean: 0.887587 2021-03-09 19:15:49.501: INFO @log_variables: train gender_confidence/loss nanmean: 0.066993 2021-03-09 19:15:49.501: INFO @log_variables: train gender_confidence/accuracy mean: 0.794126 2021-03-09 19:15:49.501: INFO @log_variables: train age_confidence/loss mean: 0.060048 2021-03-09 19:15:49.501: INFO @log_variables: train age_confidence/accuracy mean: 0.659216 2021-03-09 19:15:49.501: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:15:49.503: INFO @metrics_hook: train age_mae: 8.149 +-0.144 (13824) 2021-03-09 19:15:49.505: INFO @metrics_hook: train gender_accuracy: 0.888 +-0.005 (13824) 2021-03-09 19:15:51.807: INFO @decay_lr : LR updated to `6.635414e-05` 2021-03-09 19:15:51.810: INFO @log_profile : T train: 18.329168 2021-03-09 19:15:51.810: INFO @log_profile : T read data: 0.468671 2021-03-09 19:15:51.810: INFO @log_profile : T hooks: 2.786914 2021-03-09 19:15:51.810: INFO @main_loop : Epoch 301 done 2021-03-09 19:15:51.810: INFO @main_loop : Training epoch 302 2021-03-09 19:16:11.243: INFO @log_variables: train loss nanmean: 1.166965 2021-03-09 19:16:11.243: INFO @log_variables: train age_loss mean: 8.827782 2021-03-09 19:16:11.243: INFO @log_variables: train gender_loss mean: 0.261794 2021-03-09 19:16:11.243: INFO @log_variables: train age_mae mean: 8.273139 2021-03-09 19:16:11.243: INFO @log_variables: train gender_accuracy mean: 0.890336 2021-03-09 19:16:11.244: INFO @log_variables: train gender_confidence/loss nanmean: 0.066841 2021-03-09 19:16:11.244: INFO @log_variables: train gender_confidence/accuracy mean: 0.792752 2021-03-09 19:16:11.244: INFO @log_variables: train age_confidence/loss mean: 0.059604 2021-03-09 19:16:11.244: INFO @log_variables: train age_confidence/accuracy mean: 0.663845 2021-03-09 19:16:11.244: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:16:11.246: INFO @metrics_hook: train age_mae: 8.273 +-0.146 (13824) 2021-03-09 19:16:11.248: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 19:16:13.651: INFO @decay_lr : LR updated to `6.6022374e-05` 2021-03-09 19:16:13.652: INFO @log_profile : T train: 18.535222 2021-03-09 19:16:13.652: INFO @log_profile : T read data: 0.344554 2021-03-09 19:16:13.652: INFO @log_profile : T hooks: 2.910285 2021-03-09 19:16:13.652: INFO @main_loop : Epoch 302 done 2021-03-09 19:16:13.652: INFO @main_loop : Training epoch 303 2021-03-09 19:16:33.420: INFO @log_variables: train loss nanmean: 1.152438 2021-03-09 19:16:33.421: INFO @log_variables: train age_loss mean: 8.718152 2021-03-09 19:16:33.421: INFO @log_variables: train gender_loss mean: 0.255272 2021-03-09 19:16:33.421: INFO @log_variables: train age_mae mean: 8.163767 2021-03-09 19:16:33.421: INFO @log_variables: train gender_accuracy mean: 0.891999 2021-03-09 19:16:33.421: INFO @log_variables: train gender_confidence/loss nanmean: 0.068306 2021-03-09 19:16:33.421: INFO @log_variables: train gender_confidence/accuracy mean: 0.787977 2021-03-09 19:16:33.421: INFO @log_variables: train age_confidence/loss mean: 0.059507 2021-03-09 19:16:33.421: INFO @log_variables: train age_confidence/accuracy mean: 0.662977 2021-03-09 19:16:33.421: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:16:33.422: INFO @metrics_hook: train age_mae: 8.164 +-0.141 (13824) 2021-03-09 19:16:33.424: INFO @metrics_hook: train gender_accuracy: 0.892 +-0.005 (13824) 2021-03-09 19:16:35.813: INFO @decay_lr : LR updated to `6.5692264e-05` 2021-03-09 19:16:35.814: INFO @log_profile : T train: 18.855739 2021-03-09 19:16:35.815: INFO @log_profile : T read data: 0.370835 2021-03-09 19:16:35.815: INFO @log_profile : T hooks: 2.882885 2021-03-09 19:16:35.815: INFO @main_loop : Epoch 303 done 2021-03-09 19:16:35.815: INFO @main_loop : Training epoch 304 2021-03-09 19:16:57.206: INFO @log_variables: train loss nanmean: 1.148880 2021-03-09 19:16:57.206: INFO @log_variables: train age_loss mean: 8.709920 2021-03-09 19:16:57.206: INFO @log_variables: train gender_loss mean: 0.252748 2021-03-09 19:16:57.206: INFO @log_variables: train age_mae mean: 8.157652 2021-03-09 19:16:57.206: INFO @log_variables: train gender_accuracy mean: 0.894242 2021-03-09 19:16:57.206: INFO @log_variables: train gender_confidence/loss nanmean: 0.067647 2021-03-09 19:16:57.207: INFO @log_variables: train gender_confidence/accuracy mean: 0.792028 2021-03-09 19:16:57.207: INFO @log_variables: train age_confidence/loss mean: 0.059652 2021-03-09 19:16:57.207: INFO @log_variables: train age_confidence/accuracy mean: 0.663339 2021-03-09 19:16:57.207: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:16:57.209: INFO @metrics_hook: train age_mae: 8.158 +-0.144 (13824) 2021-03-09 19:16:57.211: INFO @metrics_hook: train gender_accuracy: 0.894 +-0.005 (13824) 2021-03-09 19:17:00.014: INFO @decay_lr : LR updated to `6.5363805e-05` 2021-03-09 19:17:00.015: INFO @log_profile : T train: 20.027732 2021-03-09 19:17:00.015: INFO @log_profile : T read data: 0.745373 2021-03-09 19:17:00.015: INFO @log_profile : T hooks: 3.368101 2021-03-09 19:17:00.015: INFO @main_loop : Epoch 304 done 2021-03-09 19:17:00.015: INFO @main_loop : Training epoch 305 2021-03-09 19:17:21.579: INFO @log_variables: train loss nanmean: 1.156388 2021-03-09 19:17:21.580: INFO @log_variables: train age_loss mean: 8.622168 2021-03-09 19:17:21.580: INFO @log_variables: train gender_loss mean: 0.266898 2021-03-09 19:17:21.580: INFO @log_variables: train age_mae mean: 8.069783 2021-03-09 19:17:21.580: INFO @log_variables: train gender_accuracy mean: 0.890987 2021-03-09 19:17:21.580: INFO @log_variables: train gender_confidence/loss nanmean: 0.069935 2021-03-09 19:17:21.580: INFO @log_variables: train gender_confidence/accuracy mean: 0.782697 2021-03-09 19:17:21.580: INFO @log_variables: train age_confidence/loss mean: 0.059985 2021-03-09 19:17:21.580: INFO @log_variables: train age_confidence/accuracy mean: 0.661314 2021-03-09 19:17:21.580: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:17:21.582: INFO @metrics_hook: train age_mae: 8.070 +-0.141 (13824) 2021-03-09 19:17:21.586: INFO @metrics_hook: train gender_accuracy: 0.891 +-0.005 (13824) 2021-03-09 19:17:25.273: INFO @decay_lr : LR updated to `6.5036984e-05` 2021-03-09 19:17:25.279: INFO @log_profile : T train: 20.538754 2021-03-09 19:17:25.280: INFO @log_profile : T read data: 0.467867 2021-03-09 19:17:25.283: INFO @log_profile : T hooks: 4.194785 2021-03-09 19:17:25.285: INFO @main_loop : Epoch 305 done 2021-03-09 19:17:25.287: INFO @main_loop : Training epoch 306 2021-03-09 19:17:47.330: INFO @log_variables: train loss nanmean: 1.149996 2021-03-09 19:17:47.331: INFO @log_variables: train age_loss mean: 8.672310 2021-03-09 19:17:47.331: INFO @log_variables: train gender_loss mean: 0.257848 2021-03-09 19:17:47.331: INFO @log_variables: train age_mae mean: 8.120357 2021-03-09 19:17:47.331: INFO @log_variables: train gender_accuracy mean: 0.891421 2021-03-09 19:17:47.331: INFO @log_variables: train gender_confidence/loss nanmean: 0.067541 2021-03-09 19:17:47.331: INFO @log_variables: train gender_confidence/accuracy mean: 0.792245 2021-03-09 19:17:47.331: INFO @log_variables: train age_confidence/loss mean: 0.059656 2021-03-09 19:17:47.331: INFO @log_variables: train age_confidence/accuracy mean: 0.662616 2021-03-09 19:17:47.331: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:17:47.333: INFO @metrics_hook: train age_mae: 8.120 +-0.143 (13824) 2021-03-09 19:17:47.335: INFO @metrics_hook: train gender_accuracy: 0.891 +-0.005 (13824) 2021-03-09 19:17:50.420: INFO @decay_lr : LR updated to `6.47118e-05` 2021-03-09 19:17:50.422: INFO @log_profile : T train: 20.919744 2021-03-09 19:17:50.422: INFO @log_profile : T read data: 0.552524 2021-03-09 19:17:50.422: INFO @log_profile : T hooks: 3.601340 2021-03-09 19:17:50.422: INFO @main_loop : Epoch 306 done 2021-03-09 19:17:50.422: INFO @main_loop : Training epoch 307 2021-03-09 19:18:10.335: INFO @log_variables: train loss nanmean: 1.153082 2021-03-09 19:18:10.335: INFO @log_variables: train age_loss mean: 8.684464 2021-03-09 19:18:10.335: INFO @log_variables: train gender_loss mean: 0.260930 2021-03-09 19:18:10.335: INFO @log_variables: train age_mae mean: 8.133008 2021-03-09 19:18:10.335: INFO @log_variables: train gender_accuracy mean: 0.890119 2021-03-09 19:18:10.335: INFO @log_variables: train gender_confidence/loss nanmean: 0.067223 2021-03-09 19:18:10.335: INFO @log_variables: train gender_confidence/accuracy mean: 0.786531 2021-03-09 19:18:10.335: INFO @log_variables: train age_confidence/loss mean: 0.059153 2021-03-09 19:18:10.336: INFO @log_variables: train age_confidence/accuracy mean: 0.664135 2021-03-09 19:18:10.336: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:18:10.338: INFO @metrics_hook: train age_mae: 8.133 +-0.142 (13824) 2021-03-09 19:18:10.341: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 19:18:12.623: INFO @decay_lr : LR updated to `6.438824e-05` 2021-03-09 19:18:12.625: INFO @log_profile : T train: 18.972384 2021-03-09 19:18:12.625: INFO @log_profile : T read data: 0.395429 2021-03-09 19:18:12.625: INFO @log_profile : T hooks: 2.780964 2021-03-09 19:18:12.626: INFO @main_loop : Epoch 307 done 2021-03-09 19:18:12.626: INFO @main_loop : Training epoch 308 2021-03-09 19:18:32.206: INFO @log_variables: train loss nanmean: 1.156214 2021-03-09 19:18:32.208: INFO @log_variables: train age_loss mean: 8.743883 2021-03-09 19:18:32.210: INFO @log_variables: train gender_loss mean: 0.257723 2021-03-09 19:18:32.210: INFO @log_variables: train age_mae mean: 8.189429 2021-03-09 19:18:32.210: INFO @log_variables: train gender_accuracy mean: 0.891493 2021-03-09 19:18:32.210: INFO @log_variables: train gender_confidence/loss nanmean: 0.067930 2021-03-09 19:18:32.210: INFO @log_variables: train gender_confidence/accuracy mean: 0.792679 2021-03-09 19:18:32.210: INFO @log_variables: train age_confidence/loss mean: 0.059092 2021-03-09 19:18:32.210: INFO @log_variables: train age_confidence/accuracy mean: 0.665365 2021-03-09 19:18:32.210: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:18:32.212: INFO @metrics_hook: train age_mae: 8.189 +-0.143 (13824) 2021-03-09 19:18:32.214: INFO @metrics_hook: train gender_accuracy: 0.891 +-0.005 (13824) 2021-03-09 19:18:34.528: INFO @decay_lr : LR updated to `6.40663e-05` 2021-03-09 19:18:34.530: INFO @log_profile : T train: 18.542360 2021-03-09 19:18:34.530: INFO @log_profile : T read data: 0.476005 2021-03-09 19:18:34.530: INFO @log_profile : T hooks: 2.831705 2021-03-09 19:18:34.530: INFO @main_loop : Epoch 308 done 2021-03-09 19:18:34.530: INFO @main_loop : Training epoch 309 2021-03-09 19:18:54.042: INFO @log_variables: train loss nanmean: 1.144583 2021-03-09 19:18:54.042: INFO @log_variables: train age_loss mean: 8.677381 2021-03-09 19:18:54.042: INFO @log_variables: train gender_loss mean: 0.249690 2021-03-09 19:18:54.042: INFO @log_variables: train age_mae mean: 8.124797 2021-03-09 19:18:54.042: INFO @log_variables: train gender_accuracy mean: 0.895833 2021-03-09 19:18:54.043: INFO @log_variables: train gender_confidence/loss nanmean: 0.069040 2021-03-09 19:18:54.043: INFO @log_variables: train gender_confidence/accuracy mean: 0.790871 2021-03-09 19:18:54.043: INFO @log_variables: train age_confidence/loss mean: 0.059700 2021-03-09 19:18:54.043: INFO @log_variables: train age_confidence/accuracy mean: 0.661675 2021-03-09 19:18:54.043: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:18:54.045: INFO @metrics_hook: train age_mae: 8.125 +-0.144 (13824) 2021-03-09 19:18:54.046: INFO @metrics_hook: train gender_accuracy: 0.896 +-0.005 (13824) 2021-03-09 19:18:56.492: INFO @decay_lr : LR updated to `6.374597e-05` 2021-03-09 19:18:56.493: INFO @log_profile : T train: 18.580305 2021-03-09 19:18:56.493: INFO @log_profile : T read data: 0.372855 2021-03-09 19:18:56.493: INFO @log_profile : T hooks: 2.953690 2021-03-09 19:18:56.493: INFO @main_loop : Epoch 309 done 2021-03-09 19:18:56.493: INFO @main_loop : Training epoch 310 2021-03-09 19:19:16.360: INFO @log_variables: train loss nanmean: 1.155917 2021-03-09 19:19:16.360: INFO @log_variables: train age_loss mean: 8.789125 2021-03-09 19:19:16.360: INFO @log_variables: train gender_loss mean: 0.252399 2021-03-09 19:19:16.360: INFO @log_variables: train age_mae mean: 8.232197 2021-03-09 19:19:16.360: INFO @log_variables: train gender_accuracy mean: 0.893953 2021-03-09 19:19:16.360: INFO @log_variables: train gender_confidence/loss nanmean: 0.068214 2021-03-09 19:19:16.360: INFO @log_variables: train gender_confidence/accuracy mean: 0.791233 2021-03-09 19:19:16.360: INFO @log_variables: train age_confidence/loss mean: 0.059238 2021-03-09 19:19:16.360: INFO @log_variables: train age_confidence/accuracy mean: 0.660952 2021-03-09 19:19:16.360: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:19:16.362: INFO @metrics_hook: train age_mae: 8.232 +-0.144 (13824) 2021-03-09 19:19:16.363: INFO @metrics_hook: train gender_accuracy: 0.894 +-0.005 (13824) 2021-03-09 19:19:18.506: INFO @decay_lr : LR updated to `6.342724e-05` 2021-03-09 19:19:18.508: INFO @log_profile : T train: 18.860826 2021-03-09 19:19:18.508: INFO @log_profile : T read data: 0.353988 2021-03-09 19:19:18.508: INFO @log_profile : T hooks: 2.746275 2021-03-09 19:19:18.508: INFO @main_loop : Epoch 310 done 2021-03-09 19:19:18.509: INFO @main_loop : Training epoch 311 2021-03-09 19:19:38.326: INFO @log_variables: train loss nanmean: 1.131878 2021-03-09 19:19:38.327: INFO @log_variables: train age_loss mean: 8.648866 2021-03-09 19:19:38.327: INFO @log_variables: train gender_loss mean: 0.240850 2021-03-09 19:19:38.327: INFO @log_variables: train age_mae mean: 8.096342 2021-03-09 19:19:38.327: INFO @log_variables: train gender_accuracy mean: 0.899732 2021-03-09 19:19:38.327: INFO @log_variables: train gender_confidence/loss nanmean: 0.067154 2021-03-09 19:19:38.327: INFO @log_variables: train gender_confidence/accuracy mean: 0.794111 2021-03-09 19:19:38.327: INFO @log_variables: train age_confidence/loss mean: 0.059509 2021-03-09 19:19:38.327: INFO @log_variables: train age_confidence/accuracy mean: 0.653765 2021-03-09 19:19:38.327: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:19:38.330: INFO @metrics_hook: train age_mae: 8.096 +-0.140 (13823) 2021-03-09 19:19:38.332: INFO @metrics_hook: train gender_accuracy: 0.900 +-0.005 (13823) 2021-03-09 19:19:40.899: INFO @decay_lr : LR updated to `6.31101e-05` 2021-03-09 19:19:40.901: INFO @log_profile : T train: 18.724605 2021-03-09 19:19:40.902: INFO @log_profile : T read data: 0.482809 2021-03-09 19:19:40.902: INFO @log_profile : T hooks: 3.130603 2021-03-09 19:19:40.902: INFO @main_loop : Epoch 311 done 2021-03-09 19:19:40.902: INFO @main_loop : Training epoch 312 2021-03-09 19:20:02.162: INFO @log_variables: train loss nanmean: 1.141631 2021-03-09 19:20:02.162: INFO @log_variables: train age_loss mean: 8.681789 2021-03-09 19:20:02.162: INFO @log_variables: train gender_loss mean: 0.247650 2021-03-09 19:20:02.162: INFO @log_variables: train age_mae mean: 8.131964 2021-03-09 19:20:02.162: INFO @log_variables: train gender_accuracy mean: 0.897859 2021-03-09 19:20:02.162: INFO @log_variables: train gender_confidence/loss nanmean: 0.068171 2021-03-09 19:20:02.162: INFO @log_variables: train gender_confidence/accuracy mean: 0.795211 2021-03-09 19:20:02.162: INFO @log_variables: train age_confidence/loss mean: 0.059070 2021-03-09 19:20:02.162: INFO @log_variables: train age_confidence/accuracy mean: 0.665871 2021-03-09 19:20:02.162: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:20:02.164: INFO @metrics_hook: train age_mae: 8.132 +-0.142 (13824) 2021-03-09 19:20:02.165: INFO @metrics_hook: train gender_accuracy: 0.898 +-0.005 (13824) 2021-03-09 19:20:05.102: INFO @decay_lr : LR updated to `6.279455e-05` 2021-03-09 19:20:05.107: INFO @log_profile : T train: 20.187277 2021-03-09 19:20:05.107: INFO @log_profile : T read data: 0.465367 2021-03-09 19:20:05.107: INFO @log_profile : T hooks: 3.492872 2021-03-09 19:20:05.107: INFO @main_loop : Epoch 312 done 2021-03-09 19:20:05.108: INFO @main_loop : Training epoch 313 2021-03-09 19:20:26.184: INFO @log_variables: train loss nanmean: 1.138705 2021-03-09 19:20:26.185: INFO @log_variables: train age_loss mean: 8.622837 2021-03-09 19:20:26.185: INFO @log_variables: train gender_loss mean: 0.250698 2021-03-09 19:20:26.185: INFO @log_variables: train age_mae mean: 8.070248 2021-03-09 19:20:26.185: INFO @log_variables: train gender_accuracy mean: 0.895110 2021-03-09 19:20:26.185: INFO @log_variables: train gender_confidence/loss nanmean: 0.067432 2021-03-09 19:20:26.185: INFO @log_variables: train gender_confidence/accuracy mean: 0.789569 2021-03-09 19:20:26.186: INFO @log_variables: train age_confidence/loss mean: 0.059471 2021-03-09 19:20:26.186: INFO @log_variables: train age_confidence/accuracy mean: 0.664207 2021-03-09 19:20:26.186: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:20:26.190: INFO @metrics_hook: train age_mae: 8.070 +-0.140 (13824) 2021-03-09 19:20:26.194: INFO @metrics_hook: train gender_accuracy: 0.895 +-0.005 (13824) 2021-03-09 19:20:29.130: INFO @decay_lr : LR updated to `6.2480576e-05` 2021-03-09 19:20:29.133: INFO @log_profile : T train: 19.990036 2021-03-09 19:20:29.133: INFO @log_profile : T read data: 0.434494 2021-03-09 19:20:29.134: INFO @log_profile : T hooks: 3.520711 2021-03-09 19:20:29.134: INFO @main_loop : Epoch 313 done 2021-03-09 19:20:29.134: INFO @main_loop : Training epoch 314 2021-03-09 19:20:50.308: INFO @log_variables: train loss nanmean: 1.156992 2021-03-09 19:20:50.308: INFO @log_variables: train age_loss mean: 8.730565 2021-03-09 19:20:50.308: INFO @log_variables: train gender_loss mean: 0.258553 2021-03-09 19:20:50.308: INFO @log_variables: train age_mae mean: 8.177968 2021-03-09 19:20:50.308: INFO @log_variables: train gender_accuracy mean: 0.893084 2021-03-09 19:20:50.308: INFO @log_variables: train gender_confidence/loss nanmean: 0.068554 2021-03-09 19:20:50.308: INFO @log_variables: train gender_confidence/accuracy mean: 0.781684 2021-03-09 19:20:50.309: INFO @log_variables: train age_confidence/loss mean: 0.059702 2021-03-09 19:20:50.309: INFO @log_variables: train age_confidence/accuracy mean: 0.663411 2021-03-09 19:20:50.309: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:20:50.310: INFO @metrics_hook: train age_mae: 8.178 +-0.141 (13824) 2021-03-09 19:20:50.312: INFO @metrics_hook: train gender_accuracy: 0.893 +-0.005 (13824) 2021-03-09 19:20:53.403: INFO @decay_lr : LR updated to `6.2168176e-05` 2021-03-09 19:20:53.405: INFO @log_profile : T train: 19.965080 2021-03-09 19:20:53.405: INFO @log_profile : T read data: 0.629100 2021-03-09 19:20:53.405: INFO @log_profile : T hooks: 3.615120 2021-03-09 19:20:53.405: INFO @main_loop : Epoch 314 done 2021-03-09 19:20:53.405: INFO @main_loop : Training epoch 315 2021-03-09 19:21:14.190: INFO @log_variables: train loss nanmean: 1.149208 2021-03-09 19:21:14.191: INFO @log_variables: train age_loss mean: 8.696890 2021-03-09 19:21:14.191: INFO @log_variables: train gender_loss mean: 0.253023 2021-03-09 19:21:14.191: INFO @log_variables: train age_mae mean: 8.145926 2021-03-09 19:21:14.191: INFO @log_variables: train gender_accuracy mean: 0.896991 2021-03-09 19:21:14.191: INFO @log_variables: train gender_confidence/loss nanmean: 0.068771 2021-03-09 19:21:14.191: INFO @log_variables: train gender_confidence/accuracy mean: 0.786458 2021-03-09 19:21:14.191: INFO @log_variables: train age_confidence/loss mean: 0.059790 2021-03-09 19:21:14.191: INFO @log_variables: train age_confidence/accuracy mean: 0.659361 2021-03-09 19:21:14.191: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:21:14.193: INFO @metrics_hook: train age_mae: 8.146 +-0.143 (13824) 2021-03-09 19:21:14.195: INFO @metrics_hook: train gender_accuracy: 0.897 +-0.005 (13824) 2021-03-09 19:21:16.530: INFO @decay_lr : LR updated to `6.185733e-05` 2021-03-09 19:21:16.533: INFO @log_profile : T train: 19.704464 2021-03-09 19:21:16.533: INFO @log_profile : T read data: 0.418023 2021-03-09 19:21:16.533: INFO @log_profile : T hooks: 2.944866 2021-03-09 19:21:16.533: INFO @main_loop : Epoch 315 done 2021-03-09 19:21:16.533: INFO @main_loop : Training epoch 316 2021-03-09 19:21:35.784: INFO @log_variables: train loss nanmean: 1.142294 2021-03-09 19:21:35.784: INFO @log_variables: train age_loss mean: 8.659450 2021-03-09 19:21:35.785: INFO @log_variables: train gender_loss mean: 0.250277 2021-03-09 19:21:35.785: INFO @log_variables: train age_mae mean: 8.110079 2021-03-09 19:21:35.785: INFO @log_variables: train gender_accuracy mean: 0.894025 2021-03-09 19:21:35.785: INFO @log_variables: train gender_confidence/loss nanmean: 0.068547 2021-03-09 19:21:35.785: INFO @log_variables: train gender_confidence/accuracy mean: 0.787399 2021-03-09 19:21:35.785: INFO @log_variables: train age_confidence/loss mean: 0.059000 2021-03-09 19:21:35.785: INFO @log_variables: train age_confidence/accuracy mean: 0.666305 2021-03-09 19:21:35.785: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:21:35.787: INFO @metrics_hook: train age_mae: 8.110 +-0.140 (13824) 2021-03-09 19:21:35.789: INFO @metrics_hook: train gender_accuracy: 0.894 +-0.005 (13824) 2021-03-09 19:21:37.874: INFO @decay_lr : LR updated to `6.1548046e-05` 2021-03-09 19:21:37.876: INFO @log_profile : T train: 18.306803 2021-03-09 19:21:37.876: INFO @log_profile : T read data: 0.335524 2021-03-09 19:21:37.876: INFO @log_profile : T hooks: 2.647220 2021-03-09 19:21:37.876: INFO @main_loop : Epoch 316 done 2021-03-09 19:21:37.876: INFO @main_loop : Training epoch 317 2021-03-09 19:21:56.956: INFO @log_variables: train loss nanmean: 1.135438 2021-03-09 19:21:56.956: INFO @log_variables: train age_loss mean: 8.659909 2021-03-09 19:21:56.956: INFO @log_variables: train gender_loss mean: 0.243773 2021-03-09 19:21:56.956: INFO @log_variables: train age_mae mean: 8.108677 2021-03-09 19:21:56.956: INFO @log_variables: train gender_accuracy mean: 0.898944 2021-03-09 19:21:56.957: INFO @log_variables: train gender_confidence/loss nanmean: 0.067091 2021-03-09 19:21:56.957: INFO @log_variables: train gender_confidence/accuracy mean: 0.799696 2021-03-09 19:21:56.957: INFO @log_variables: train age_confidence/loss mean: 0.059471 2021-03-09 19:21:56.957: INFO @log_variables: train age_confidence/accuracy mean: 0.664497 2021-03-09 19:21:56.957: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:21:56.959: INFO @metrics_hook: train age_mae: 8.109 +-0.141 (13824) 2021-03-09 19:21:56.961: INFO @metrics_hook: train gender_accuracy: 0.899 +-0.005 (13824) 2021-03-09 19:21:58.970: INFO @decay_lr : LR updated to `6.124031e-05` 2021-03-09 19:21:58.972: INFO @log_profile : T train: 18.084857 2021-03-09 19:21:58.972: INFO @log_profile : T read data: 0.436546 2021-03-09 19:21:58.972: INFO @log_profile : T hooks: 2.525267 2021-03-09 19:21:58.972: INFO @main_loop : Epoch 317 done 2021-03-09 19:21:58.972: INFO @main_loop : Training epoch 318 2021-03-09 19:22:18.171: INFO @log_variables: train loss nanmean: 1.152268 2021-03-09 19:22:18.171: INFO @log_variables: train age_loss mean: 8.763833 2021-03-09 19:22:18.172: INFO @log_variables: train gender_loss mean: 0.250792 2021-03-09 19:22:18.172: INFO @log_variables: train age_mae mean: 8.211312 2021-03-09 19:22:18.172: INFO @log_variables: train gender_accuracy mean: 0.896050 2021-03-09 19:22:18.172: INFO @log_variables: train gender_confidence/loss nanmean: 0.068523 2021-03-09 19:22:18.172: INFO @log_variables: train gender_confidence/accuracy mean: 0.789280 2021-03-09 19:22:18.172: INFO @log_variables: train age_confidence/loss mean: 0.059039 2021-03-09 19:22:18.172: INFO @log_variables: train age_confidence/accuracy mean: 0.669777 2021-03-09 19:22:18.172: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:22:18.174: INFO @metrics_hook: train age_mae: 8.211 +-0.142 (13824) 2021-03-09 19:22:18.176: INFO @metrics_hook: train gender_accuracy: 0.896 +-0.005 (13824) 2021-03-09 19:22:20.249: INFO @decay_lr : LR updated to `6.0934108e-05` 2021-03-09 19:22:20.251: INFO @log_profile : T train: 18.351696 2021-03-09 19:22:20.251: INFO @log_profile : T read data: 0.305281 2021-03-09 19:22:20.251: INFO @log_profile : T hooks: 2.573260 2021-03-09 19:22:20.251: INFO @main_loop : Epoch 318 done 2021-03-09 19:22:20.251: INFO @main_loop : Training epoch 319 2021-03-09 19:22:39.235: INFO @log_variables: train loss nanmean: 1.148277 2021-03-09 19:22:39.236: INFO @log_variables: train age_loss mean: 8.643288 2021-03-09 19:22:39.236: INFO @log_variables: train gender_loss mean: 0.259394 2021-03-09 19:22:39.236: INFO @log_variables: train age_mae mean: 8.091570 2021-03-09 19:22:39.236: INFO @log_variables: train gender_accuracy mean: 0.889829 2021-03-09 19:22:39.236: INFO @log_variables: train gender_confidence/loss nanmean: 0.067032 2021-03-09 19:22:39.236: INFO @log_variables: train gender_confidence/accuracy mean: 0.791233 2021-03-09 19:22:39.237: INFO @log_variables: train age_confidence/loss mean: 0.059679 2021-03-09 19:22:39.237: INFO @log_variables: train age_confidence/accuracy mean: 0.659939 2021-03-09 19:22:39.237: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:22:39.239: INFO @metrics_hook: train age_mae: 8.092 +-0.142 (13824) 2021-03-09 19:22:39.241: INFO @metrics_hook: train gender_accuracy: 0.890 +-0.005 (13824) 2021-03-09 19:22:41.394: INFO @decay_lr : LR updated to `6.0629438e-05` 2021-03-09 19:22:41.395: INFO @log_profile : T train: 18.122416 2021-03-09 19:22:41.395: INFO @log_profile : T read data: 0.313929 2021-03-09 19:22:41.395: INFO @log_profile : T hooks: 2.658951 2021-03-09 19:22:41.395: INFO @main_loop : Epoch 319 done 2021-03-09 19:22:41.396: INFO @main_loop : Training epoch 320 2021-03-09 19:23:01.118: INFO @log_variables: train loss nanmean: 1.136541 2021-03-09 19:23:01.118: INFO @log_variables: train age_loss mean: 8.525248 2021-03-09 19:23:01.118: INFO @log_variables: train gender_loss mean: 0.255612 2021-03-09 19:23:01.118: INFO @log_variables: train age_mae mean: 7.976748 2021-03-09 19:23:01.118: INFO @log_variables: train gender_accuracy mean: 0.892353 2021-03-09 19:23:01.119: INFO @log_variables: train gender_confidence/loss nanmean: 0.068923 2021-03-09 19:23:01.119: INFO @log_variables: train gender_confidence/accuracy mean: 0.791579 2021-03-09 19:23:01.119: INFO @log_variables: train age_confidence/loss mean: 0.060220 2021-03-09 19:23:01.119: INFO @log_variables: train age_confidence/accuracy mean: 0.653114 2021-03-09 19:23:01.119: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:23:01.120: INFO @metrics_hook: train age_mae: 7.977 +-0.141 (13823) 2021-03-09 19:23:01.121: INFO @metrics_hook: train gender_accuracy: 0.892 +-0.005 (13823) 2021-03-09 19:23:03.531: INFO @decay_lr : LR updated to `6.0326292e-05` 2021-03-09 19:23:03.533: INFO @log_profile : T train: 18.681100 2021-03-09 19:23:03.533: INFO @log_profile : T read data: 0.523305 2021-03-09 19:23:03.533: INFO @log_profile : T hooks: 2.880829 2021-03-09 19:23:03.533: INFO @main_loop : Epoch 320 done 2021-03-09 19:23:03.533: INFO @main_loop : Training epoch 321 2021-03-09 19:23:23.923: INFO @log_variables: train loss nanmean: 1.143379 2021-03-09 19:23:23.924: INFO @log_variables: train age_loss mean: 8.671225 2021-03-09 19:23:23.924: INFO @log_variables: train gender_loss mean: 0.248996 2021-03-09 19:23:23.924: INFO @log_variables: train age_mae mean: 8.119188 2021-03-09 19:23:23.924: INFO @log_variables: train gender_accuracy mean: 0.899233 2021-03-09 19:23:23.924: INFO @log_variables: train gender_confidence/loss nanmean: 0.069308 2021-03-09 19:23:23.924: INFO @log_variables: train gender_confidence/accuracy mean: 0.789062 2021-03-09 19:23:23.924: INFO @log_variables: train age_confidence/loss mean: 0.059418 2021-03-09 19:23:23.924: INFO @log_variables: train age_confidence/accuracy mean: 0.663267 2021-03-09 19:23:23.925: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:23:23.927: INFO @metrics_hook: train age_mae: 8.119 +-0.142 (13824) 2021-03-09 19:23:23.930: INFO @metrics_hook: train gender_accuracy: 0.899 +-0.005 (13824) 2021-03-09 19:23:26.735: INFO @decay_lr : LR updated to `6.002466e-05` 2021-03-09 19:23:26.737: INFO @log_profile : T train: 19.367740 2021-03-09 19:23:26.737: INFO @log_profile : T read data: 0.464866 2021-03-09 19:23:26.737: INFO @log_profile : T hooks: 3.316477 2021-03-09 19:23:26.737: INFO @main_loop : Epoch 321 done 2021-03-09 19:23:26.737: INFO @main_loop : Training epoch 322 2021-03-09 19:23:47.889: INFO @log_variables: train loss nanmean: 1.131425 2021-03-09 19:23:47.889: INFO @log_variables: train age_loss mean: 8.545453 2021-03-09 19:23:47.889: INFO @log_variables: train gender_loss mean: 0.250062 2021-03-09 19:23:47.889: INFO @log_variables: train age_mae mean: 7.999787 2021-03-09 19:23:47.890: INFO @log_variables: train gender_accuracy mean: 0.894748 2021-03-09 19:23:47.890: INFO @log_variables: train gender_confidence/loss nanmean: 0.067688 2021-03-09 19:23:47.890: INFO @log_variables: train gender_confidence/accuracy mean: 0.797020 2021-03-09 19:23:47.890: INFO @log_variables: train age_confidence/loss mean: 0.059548 2021-03-09 19:23:47.890: INFO @log_variables: train age_confidence/accuracy mean: 0.667679 2021-03-09 19:23:47.890: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:23:47.892: INFO @metrics_hook: train age_mae: 8.000 +-0.142 (13824) 2021-03-09 19:23:47.893: INFO @metrics_hook: train gender_accuracy: 0.895 +-0.005 (13824) 2021-03-09 19:23:50.646: INFO @decay_lr : LR updated to `5.9724538e-05` 2021-03-09 19:23:50.648: INFO @log_profile : T train: 20.088672 2021-03-09 19:23:50.648: INFO @log_profile : T read data: 0.471399 2021-03-09 19:23:50.648: INFO @log_profile : T hooks: 3.288369 2021-03-09 19:23:50.648: INFO @main_loop : Epoch 322 done 2021-03-09 19:23:50.648: INFO @main_loop : Training epoch 323 2021-03-09 19:24:10.657: INFO @log_variables: train loss nanmean: 1.137673 2021-03-09 19:24:10.657: INFO @log_variables: train age_loss mean: 8.593922 2021-03-09 19:24:10.658: INFO @log_variables: train gender_loss mean: 0.252766 2021-03-09 19:24:10.658: INFO @log_variables: train age_mae mean: 8.045797 2021-03-09 19:24:10.658: INFO @log_variables: train gender_accuracy mean: 0.895182 2021-03-09 19:24:10.658: INFO @log_variables: train gender_confidence/loss nanmean: 0.066956 2021-03-09 19:24:10.658: INFO @log_variables: train gender_confidence/accuracy mean: 0.793837 2021-03-09 19:24:10.658: INFO @log_variables: train age_confidence/loss mean: 0.059665 2021-03-09 19:24:10.658: INFO @log_variables: train age_confidence/accuracy mean: 0.662326 2021-03-09 19:24:10.658: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:24:10.660: INFO @metrics_hook: train age_mae: 8.046 +-0.140 (13824) 2021-03-09 19:24:10.662: INFO @metrics_hook: train gender_accuracy: 0.895 +-0.005 (13824) 2021-03-09 19:24:13.039: INFO @decay_lr : LR updated to `5.9425915e-05` 2021-03-09 19:24:13.041: INFO @log_profile : T train: 19.032101 2021-03-09 19:24:13.041: INFO @log_profile : T read data: 0.406844 2021-03-09 19:24:13.041: INFO @log_profile : T hooks: 2.898437 2021-03-09 19:24:13.041: INFO @main_loop : Epoch 323 done 2021-03-09 19:24:13.041: INFO @main_loop : Training epoch 324 2021-03-09 19:24:33.088: INFO @log_variables: train loss nanmean: 1.141026 2021-03-09 19:24:33.088: INFO @log_variables: train age_loss mean: 8.699859 2021-03-09 19:24:33.088: INFO @log_variables: train gender_loss mean: 0.244923 2021-03-09 19:24:33.088: INFO @log_variables: train age_mae mean: 8.146194 2021-03-09 19:24:33.088: INFO @log_variables: train gender_accuracy mean: 0.899740 2021-03-09 19:24:33.088: INFO @log_variables: train gender_confidence/loss nanmean: 0.067797 2021-03-09 19:24:33.088: INFO @log_variables: train gender_confidence/accuracy mean: 0.793837 2021-03-09 19:24:33.089: INFO @log_variables: train age_confidence/loss mean: 0.059675 2021-03-09 19:24:33.089: INFO @log_variables: train age_confidence/accuracy mean: 0.664424 2021-03-09 19:24:33.089: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:24:33.091: INFO @metrics_hook: train age_mae: 8.146 +-0.141 (13824) 2021-03-09 19:24:33.093: INFO @metrics_hook: train gender_accuracy: 0.900 +-0.005 (13824) 2021-03-09 19:24:35.491: INFO @decay_lr : LR updated to `5.9128786e-05` 2021-03-09 19:24:35.493: INFO @log_profile : T train: 18.933916 2021-03-09 19:24:35.493: INFO @log_profile : T read data: 0.479858 2021-03-09 19:24:35.493: INFO @log_profile : T hooks: 2.979638 2021-03-09 19:24:35.493: INFO @main_loop : Epoch 324 done 2021-03-09 19:24:35.493: INFO @main_loop : Training epoch 325 2021-03-09 19:24:55.016: INFO @log_variables: train loss nanmean: 1.127450 2021-03-09 19:24:55.016: INFO @log_variables: train age_loss mean: 8.576134 2021-03-09 19:24:55.016: INFO @log_variables: train gender_loss mean: 0.243198 2021-03-09 19:24:55.017: INFO @log_variables: train age_mae mean: 8.027107 2021-03-09 19:24:55.017: INFO @log_variables: train gender_accuracy mean: 0.899161 2021-03-09 19:24:55.017: INFO @log_variables: train gender_confidence/loss nanmean: 0.066871 2021-03-09 19:24:55.017: INFO @log_variables: train gender_confidence/accuracy mean: 0.794994 2021-03-09 19:24:55.017: INFO @log_variables: train age_confidence/loss mean: 0.059841 2021-03-09 19:24:55.017: INFO @log_variables: train age_confidence/accuracy mean: 0.665871 2021-03-09 19:24:55.017: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:24:55.019: INFO @metrics_hook: train age_mae: 8.027 +-0.139 (13824) 2021-03-09 19:24:55.021: INFO @metrics_hook: train gender_accuracy: 0.899 +-0.005 (13824) 2021-03-09 19:24:57.385: INFO @decay_lr : LR updated to `5.8833142e-05` 2021-03-09 19:24:57.386: INFO @log_profile : T train: 18.574691 2021-03-09 19:24:57.386: INFO @log_profile : T read data: 0.347248 2021-03-09 19:24:57.386: INFO @log_profile : T hooks: 2.915839 2021-03-09 19:24:57.387: INFO @main_loop : Epoch 325 done 2021-03-09 19:24:57.387: INFO @main_loop : Training epoch 326 2021-03-09 19:25:16.828: INFO @log_variables: train loss nanmean: 1.144660 2021-03-09 19:25:16.829: INFO @log_variables: train age_loss mean: 8.607030 2021-03-09 19:25:16.829: INFO @log_variables: train gender_loss mean: 0.258642 2021-03-09 19:25:16.829: INFO @log_variables: train age_mae mean: 8.056759 2021-03-09 19:25:16.829: INFO @log_variables: train gender_accuracy mean: 0.893880 2021-03-09 19:25:16.829: INFO @log_variables: train gender_confidence/loss nanmean: 0.067387 2021-03-09 19:25:16.829: INFO @log_variables: train gender_confidence/accuracy mean: 0.797381 2021-03-09 19:25:16.829: INFO @log_variables: train age_confidence/loss mean: 0.059686 2021-03-09 19:25:16.829: INFO @log_variables: train age_confidence/accuracy mean: 0.662760 2021-03-09 19:25:16.829: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:25:16.832: INFO @metrics_hook: train age_mae: 8.057 +-0.143 (13824) 2021-03-09 19:25:16.834: INFO @metrics_hook: train gender_accuracy: 0.894 +-0.005 (13824) 2021-03-09 19:25:19.103: INFO @decay_lr : LR updated to `5.8538975e-05` 2021-03-09 19:25:19.105: INFO @log_profile : T train: 18.528328 2021-03-09 19:25:19.105: INFO @log_profile : T read data: 0.348968 2021-03-09 19:25:19.105: INFO @log_profile : T hooks: 2.787468 2021-03-09 19:25:19.105: INFO @main_loop : Epoch 326 done 2021-03-09 19:25:19.105: INFO @main_loop : Training epoch 327 2021-03-09 19:25:38.836: INFO @log_variables: train loss nanmean: 1.136820 2021-03-09 19:25:38.836: INFO @log_variables: train age_loss mean: 8.626682 2021-03-09 19:25:38.837: INFO @log_variables: train gender_loss mean: 0.247639 2021-03-09 19:25:38.837: INFO @log_variables: train age_mae mean: 8.079720 2021-03-09 19:25:38.837: INFO @log_variables: train gender_accuracy mean: 0.898220 2021-03-09 19:25:38.837: INFO @log_variables: train gender_confidence/loss nanmean: 0.068116 2021-03-09 19:25:38.837: INFO @log_variables: train gender_confidence/accuracy mean: 0.789714 2021-03-09 19:25:38.837: INFO @log_variables: train age_confidence/loss mean: 0.059335 2021-03-09 19:25:38.837: INFO @log_variables: train age_confidence/accuracy mean: 0.662833 2021-03-09 19:25:38.837: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:25:38.839: INFO @metrics_hook: train age_mae: 8.080 +-0.142 (13824) 2021-03-09 19:25:38.841: INFO @metrics_hook: train gender_accuracy: 0.898 +-0.005 (13824) 2021-03-09 19:25:41.727: INFO @decay_lr : LR updated to `5.824628e-05` 2021-03-09 19:25:41.730: INFO @log_profile : T train: 18.614762 2021-03-09 19:25:41.731: INFO @log_profile : T read data: 0.476942 2021-03-09 19:25:41.731: INFO @log_profile : T hooks: 3.478310 2021-03-09 19:25:41.731: INFO @main_loop : Epoch 327 done 2021-03-09 19:25:41.731: INFO @main_loop : Training epoch 328 2021-03-09 19:26:03.049: INFO @log_variables: train loss nanmean: 1.152233 2021-03-09 19:26:03.049: INFO @log_variables: train age_loss mean: 8.746023 2021-03-09 19:26:03.049: INFO @log_variables: train gender_loss mean: 0.251351 2021-03-09 19:26:03.049: INFO @log_variables: train age_mae mean: 8.194287 2021-03-09 19:26:03.049: INFO @log_variables: train gender_accuracy mean: 0.900029 2021-03-09 19:26:03.049: INFO @log_variables: train gender_confidence/loss nanmean: 0.069423 2021-03-09 19:26:03.049: INFO @log_variables: train gender_confidence/accuracy mean: 0.791016 2021-03-09 19:26:03.050: INFO @log_variables: train age_confidence/loss mean: 0.059215 2021-03-09 19:26:03.050: INFO @log_variables: train age_confidence/accuracy mean: 0.668981 2021-03-09 19:26:03.050: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:26:03.051: INFO @metrics_hook: train age_mae: 8.194 +-0.143 (13824) 2021-03-09 19:26:03.053: INFO @metrics_hook: train gender_accuracy: 0.900 +-0.005 (13824) 2021-03-09 19:26:06.074: INFO @decay_lr : LR updated to `5.795505e-05` 2021-03-09 19:26:06.076: INFO @log_profile : T train: 20.276256 2021-03-09 19:26:06.077: INFO @log_profile : T read data: 0.464142 2021-03-09 19:26:06.077: INFO @log_profile : T hooks: 3.543649 2021-03-09 19:26:06.077: INFO @main_loop : Epoch 328 done 2021-03-09 19:26:06.077: INFO @main_loop : Training epoch 329 2021-03-09 19:26:27.784: INFO @log_variables: train loss nanmean: 1.123947 2021-03-09 19:26:27.784: INFO @log_variables: train age_loss mean: 8.502446 2021-03-09 19:26:27.784: INFO @log_variables: train gender_loss mean: 0.247455 2021-03-09 19:26:27.784: INFO @log_variables: train age_mae mean: 7.954947 2021-03-09 19:26:27.784: INFO @log_variables: train gender_accuracy mean: 0.897063 2021-03-09 19:26:27.784: INFO @log_variables: train gender_confidence/loss nanmean: 0.066630 2021-03-09 19:26:27.784: INFO @log_variables: train gender_confidence/accuracy mean: 0.793475 2021-03-09 19:26:27.784: INFO @log_variables: train age_confidence/loss mean: 0.059408 2021-03-09 19:26:27.784: INFO @log_variables: train age_confidence/accuracy mean: 0.663267 2021-03-09 19:26:27.785: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:26:27.787: INFO @metrics_hook: train age_mae: 7.955 +-0.139 (13824) 2021-03-09 19:26:27.789: INFO @metrics_hook: train gender_accuracy: 0.897 +-0.005 (13824) 2021-03-09 19:26:30.634: INFO @decay_lr : LR updated to `5.7665275e-05` 2021-03-09 19:26:30.636: INFO @log_profile : T train: 20.524160 2021-03-09 19:26:30.636: INFO @log_profile : T read data: 0.578171 2021-03-09 19:26:30.636: INFO @log_profile : T hooks: 3.384377 2021-03-09 19:26:30.636: INFO @main_loop : Epoch 329 done 2021-03-09 19:26:30.637: INFO @main_loop : Training epoch 330 2021-03-09 19:26:52.295: INFO @log_variables: train loss nanmean: 1.138620 2021-03-09 19:26:52.295: INFO @log_variables: train age_loss mean: 8.550834 2021-03-09 19:26:52.301: INFO @log_variables: train gender_loss mean: 0.254708 2021-03-09 19:26:52.301: INFO @log_variables: train age_mae mean: 7.999459 2021-03-09 19:26:52.301: INFO @log_variables: train gender_accuracy mean: 0.898438 2021-03-09 19:26:52.301: INFO @log_variables: train gender_confidence/loss nanmean: 0.069516 2021-03-09 19:26:52.301: INFO @log_variables: train gender_confidence/accuracy mean: 0.785880 2021-03-09 19:26:52.301: INFO @log_variables: train age_confidence/loss mean: 0.060203 2021-03-09 19:26:52.301: INFO @log_variables: train age_confidence/accuracy mean: 0.654369 2021-03-09 19:26:52.302: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:26:52.304: INFO @metrics_hook: train age_mae: 7.999 +-0.141 (13824) 2021-03-09 19:26:52.312: INFO @metrics_hook: train gender_accuracy: 0.898 +-0.005 (13824) 2021-03-09 19:26:55.188: INFO @decay_lr : LR updated to `5.7376947e-05` 2021-03-09 19:26:55.190: INFO @log_profile : T train: 20.311505 2021-03-09 19:26:55.190: INFO @log_profile : T read data: 0.723127 2021-03-09 19:26:55.190: INFO @log_profile : T hooks: 3.454070 2021-03-09 19:26:55.190: INFO @main_loop : Epoch 330 done 2021-03-09 19:26:55.190: INFO @main_loop : Training epoch 331 2021-03-09 19:27:16.137: INFO @log_variables: train loss nanmean: 1.136457 2021-03-09 19:27:16.137: INFO @log_variables: train age_loss mean: 8.581023 2021-03-09 19:27:16.137: INFO @log_variables: train gender_loss mean: 0.252018 2021-03-09 19:27:16.137: INFO @log_variables: train age_mae mean: 8.034460 2021-03-09 19:27:16.137: INFO @log_variables: train gender_accuracy mean: 0.895472 2021-03-09 19:27:16.138: INFO @log_variables: train gender_confidence/loss nanmean: 0.068064 2021-03-09 19:27:16.138: INFO @log_variables: train gender_confidence/accuracy mean: 0.792607 2021-03-09 19:27:16.138: INFO @log_variables: train age_confidence/loss mean: 0.059193 2021-03-09 19:27:16.138: INFO @log_variables: train age_confidence/accuracy mean: 0.664207 2021-03-09 19:27:16.138: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:27:16.140: INFO @metrics_hook: train age_mae: 8.034 +-0.138 (13824) 2021-03-09 19:27:16.142: INFO @metrics_hook: train gender_accuracy: 0.895 +-0.005 (13824) 2021-03-09 19:27:18.563: INFO @decay_lr : LR updated to `5.7090063e-05` 2021-03-09 19:27:18.565: INFO @log_profile : T train: 19.922153 2021-03-09 19:27:18.565: INFO @log_profile : T read data: 0.433539 2021-03-09 19:27:18.565: INFO @log_profile : T hooks: 2.960114 2021-03-09 19:27:18.565: INFO @main_loop : Epoch 331 done 2021-03-09 19:27:18.565: INFO @main_loop : Training epoch 332 2021-03-09 19:27:38.246: INFO @log_variables: train loss nanmean: 1.124339 2021-03-09 19:27:38.247: INFO @log_variables: train age_loss mean: 8.487576 2021-03-09 19:27:38.247: INFO @log_variables: train gender_loss mean: 0.246751 2021-03-09 19:27:38.247: INFO @log_variables: train age_mae mean: 7.944603 2021-03-09 19:27:38.247: INFO @log_variables: train gender_accuracy mean: 0.898655 2021-03-09 19:27:38.247: INFO @log_variables: train gender_confidence/loss nanmean: 0.068852 2021-03-09 19:27:38.247: INFO @log_variables: train gender_confidence/accuracy mean: 0.788484 2021-03-09 19:27:38.247: INFO @log_variables: train age_confidence/loss mean: 0.059570 2021-03-09 19:27:38.247: INFO @log_variables: train age_confidence/accuracy mean: 0.664135 2021-03-09 19:27:38.247: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:27:38.249: INFO @metrics_hook: train age_mae: 7.945 +-0.140 (13824) 2021-03-09 19:27:38.250: INFO @metrics_hook: train gender_accuracy: 0.899 +-0.005 (13824) 2021-03-09 19:27:40.929: INFO @decay_lr : LR updated to `5.6804613e-05` 2021-03-09 19:27:40.932: INFO @log_profile : T train: 18.713447 2021-03-09 19:27:40.933: INFO @log_profile : T read data: 0.372278 2021-03-09 19:27:40.933: INFO @log_profile : T hooks: 3.226219 2021-03-09 19:27:40.933: INFO @main_loop : Epoch 332 done 2021-03-09 19:27:40.933: INFO @main_loop : Training epoch 333 2021-03-09 19:28:00.783: INFO @log_variables: train loss nanmean: 1.136560 2021-03-09 19:28:00.783: INFO @log_variables: train age_loss mean: 8.653224 2021-03-09 19:28:00.783: INFO @log_variables: train gender_loss mean: 0.244373 2021-03-09 19:28:00.783: INFO @log_variables: train age_mae mean: 8.103914 2021-03-09 19:28:00.784: INFO @log_variables: train gender_accuracy mean: 0.897569 2021-03-09 19:28:00.784: INFO @log_variables: train gender_confidence/loss nanmean: 0.067898 2021-03-09 19:28:00.784: INFO @log_variables: train gender_confidence/accuracy mean: 0.797020 2021-03-09 19:28:00.784: INFO @log_variables: train age_confidence/loss mean: 0.059848 2021-03-09 19:28:00.784: INFO @log_variables: train age_confidence/accuracy mean: 0.660446 2021-03-09 19:28:00.784: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:28:00.786: INFO @metrics_hook: train age_mae: 8.104 +-0.144 (13824) 2021-03-09 19:28:00.790: INFO @metrics_hook: train gender_accuracy: 0.898 +-0.005 (13824) 2021-03-09 19:28:03.224: INFO @decay_lr : LR updated to `5.652059e-05` 2021-03-09 19:28:03.225: INFO @log_profile : T train: 18.737747 2021-03-09 19:28:03.226: INFO @log_profile : T read data: 0.507117 2021-03-09 19:28:03.226: INFO @log_profile : T hooks: 2.990730 2021-03-09 19:28:03.226: INFO @main_loop : Epoch 333 done 2021-03-09 19:28:03.226: INFO @main_loop : Training epoch 334 2021-03-09 19:28:23.356: INFO @log_variables: train loss nanmean: 1.124760 2021-03-09 19:28:23.357: INFO @log_variables: train age_loss mean: 8.565514 2021-03-09 19:28:23.357: INFO @log_variables: train gender_loss mean: 0.239918 2021-03-09 19:28:23.357: INFO @log_variables: train age_mae mean: 8.018675 2021-03-09 19:28:23.357: INFO @log_variables: train gender_accuracy mean: 0.899523 2021-03-09 19:28:23.357: INFO @log_variables: train gender_confidence/loss nanmean: 0.067977 2021-03-09 19:28:23.357: INFO @log_variables: train gender_confidence/accuracy mean: 0.789280 2021-03-09 19:28:23.357: INFO @log_variables: train age_confidence/loss mean: 0.059993 2021-03-09 19:28:23.358: INFO @log_variables: train age_confidence/accuracy mean: 0.663411 2021-03-09 19:28:23.358: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:28:23.359: INFO @metrics_hook: train age_mae: 8.019 +-0.140 (13824) 2021-03-09 19:28:23.361: INFO @metrics_hook: train gender_accuracy: 0.900 +-0.005 (13824) 2021-03-09 19:28:26.180: INFO @decay_lr : LR updated to `5.6237986e-05` 2021-03-09 19:28:26.182: INFO @log_profile : T train: 19.094856 2021-03-09 19:28:26.182: INFO @log_profile : T read data: 0.450345 2021-03-09 19:28:26.182: INFO @log_profile : T hooks: 3.356314 2021-03-09 19:28:26.182: INFO @main_loop : Epoch 334 done 2021-03-09 19:28:26.182: INFO @main_loop : Training epoch 335 2021-03-09 19:28:46.384: INFO @log_variables: train loss nanmean: 1.129334 2021-03-09 19:28:46.384: INFO @log_variables: train age_loss mean: 8.493347 2021-03-09 19:28:46.385: INFO @log_variables: train gender_loss mean: 0.253695 2021-03-09 19:28:46.385: INFO @log_variables: train age_mae mean: 7.946522 2021-03-09 19:28:46.385: INFO @log_variables: train gender_accuracy mean: 0.894604 2021-03-09 19:28:46.385: INFO @log_variables: train gender_confidence/loss nanmean: 0.066501 2021-03-09 19:28:46.386: INFO @log_variables: train gender_confidence/accuracy mean: 0.792896 2021-03-09 19:28:46.386: INFO @log_variables: train age_confidence/loss mean: 0.060079 2021-03-09 19:28:46.386: INFO @log_variables: train age_confidence/accuracy mean: 0.661241 2021-03-09 19:28:46.386: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:28:46.390: INFO @metrics_hook: train age_mae: 7.947 +-0.139 (13824) 2021-03-09 19:28:46.393: INFO @metrics_hook: train gender_accuracy: 0.895 +-0.005 (13824) 2021-03-09 19:28:48.783: INFO @decay_lr : LR updated to `5.5956796e-05` 2021-03-09 19:28:48.785: INFO @log_profile : T train: 19.157718 2021-03-09 19:28:48.785: INFO @log_profile : T read data: 0.417791 2021-03-09 19:28:48.785: INFO @log_profile : T hooks: 2.970333 2021-03-09 19:28:48.785: INFO @main_loop : Epoch 335 done 2021-03-09 19:28:48.785: INFO @main_loop : Training epoch 336 2021-03-09 19:29:11.012: INFO @log_variables: train loss nanmean: 1.114815 2021-03-09 19:29:11.012: INFO @log_variables: train age_loss mean: 8.482359 2021-03-09 19:29:11.013: INFO @log_variables: train gender_loss mean: 0.239008 2021-03-09 19:29:11.013: INFO @log_variables: train age_mae mean: 7.933959 2021-03-09 19:29:11.013: INFO @log_variables: train gender_accuracy mean: 0.899957 2021-03-09 19:29:11.013: INFO @log_variables: train gender_confidence/loss nanmean: 0.066315 2021-03-09 19:29:11.013: INFO @log_variables: train gender_confidence/accuracy mean: 0.799045 2021-03-09 19:29:11.013: INFO @log_variables: train age_confidence/loss mean: 0.060096 2021-03-09 19:29:11.013: INFO @log_variables: train age_confidence/accuracy mean: 0.658348 2021-03-09 19:29:11.013: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:29:11.015: INFO @metrics_hook: train age_mae: 7.934 +-0.138 (13824) 2021-03-09 19:29:11.017: INFO @metrics_hook: train gender_accuracy: 0.900 +-0.005 (13824) 2021-03-09 19:29:14.156: INFO @decay_lr : LR updated to `5.5677014e-05` 2021-03-09 19:29:14.157: INFO @log_profile : T train: 20.939798 2021-03-09 19:29:14.158: INFO @log_profile : T read data: 0.726880 2021-03-09 19:29:14.158: INFO @log_profile : T hooks: 3.649670 2021-03-09 19:29:14.158: INFO @main_loop : Epoch 336 done 2021-03-09 19:29:14.158: INFO @main_loop : Training epoch 337 2021-03-09 19:29:35.711: INFO @log_variables: train loss nanmean: 1.142062 2021-03-09 19:29:35.712: INFO @log_variables: train age_loss mean: 8.678267 2021-03-09 19:29:35.712: INFO @log_variables: train gender_loss mean: 0.249290 2021-03-09 19:29:35.712: INFO @log_variables: train age_mae mean: 8.124628 2021-03-09 19:29:35.712: INFO @log_variables: train gender_accuracy mean: 0.897200 2021-03-09 19:29:35.712: INFO @log_variables: train gender_confidence/loss nanmean: 0.066534 2021-03-09 19:29:35.712: INFO @log_variables: train gender_confidence/accuracy mean: 0.797367 2021-03-09 19:29:35.712: INFO @log_variables: train age_confidence/loss mean: 0.059967 2021-03-09 19:29:35.712: INFO @log_variables: train age_confidence/accuracy mean: 0.657889 2021-03-09 19:29:35.712: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:29:35.715: INFO @metrics_hook: train age_mae: 8.125 +-0.142 (13823) 2021-03-09 19:29:35.717: INFO @metrics_hook: train gender_accuracy: 0.897 +-0.005 (13823) 2021-03-09 19:29:38.702: INFO @decay_lr : LR updated to `5.539863e-05` 2021-03-09 19:29:38.703: INFO @log_profile : T train: 20.454471 2021-03-09 19:29:38.704: INFO @log_profile : T read data: 0.501848 2021-03-09 19:29:38.704: INFO @log_profile : T hooks: 3.527735 2021-03-09 19:29:38.704: INFO @main_loop : Epoch 337 done 2021-03-09 19:29:38.704: INFO @main_loop : Training epoch 338 2021-03-09 19:30:00.274: INFO @log_variables: train loss nanmean: 1.142124 2021-03-09 19:30:00.277: INFO @log_variables: train age_loss mean: 8.660716 2021-03-09 19:30:00.277: INFO @log_variables: train gender_loss mean: 0.250549 2021-03-09 19:30:00.277: INFO @log_variables: train age_mae mean: 8.108788 2021-03-09 19:30:00.277: INFO @log_variables: train gender_accuracy mean: 0.895833 2021-03-09 19:30:00.277: INFO @log_variables: train gender_confidence/loss nanmean: 0.067744 2021-03-09 19:30:00.277: INFO @log_variables: train gender_confidence/accuracy mean: 0.793837 2021-03-09 19:30:00.278: INFO @log_variables: train age_confidence/loss mean: 0.059270 2021-03-09 19:30:00.279: INFO @log_variables: train age_confidence/accuracy mean: 0.669343 2021-03-09 19:30:00.280: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:30:00.281: INFO @metrics_hook: train age_mae: 8.109 +-0.140 (13824) 2021-03-09 19:30:00.284: INFO @metrics_hook: train gender_accuracy: 0.896 +-0.005 (13824) 2021-03-09 19:30:03.164: INFO @decay_lr : LR updated to `5.5121636e-05` 2021-03-09 19:30:03.166: INFO @log_profile : T train: 20.465548 2021-03-09 19:30:03.167: INFO @log_profile : T read data: 0.505491 2021-03-09 19:30:03.167: INFO @log_profile : T hooks: 3.432448 2021-03-09 19:30:03.167: INFO @main_loop : Epoch 338 done 2021-03-09 19:30:03.167: INFO @main_loop : Training epoch 339 2021-03-09 19:30:24.621: INFO @log_variables: train loss nanmean: 1.130758 2021-03-09 19:30:24.621: INFO @log_variables: train age_loss mean: 8.486845 2021-03-09 19:30:24.622: INFO @log_variables: train gender_loss mean: 0.254288 2021-03-09 19:30:24.622: INFO @log_variables: train age_mae mean: 7.942039 2021-03-09 19:30:24.622: INFO @log_variables: train gender_accuracy mean: 0.893808 2021-03-09 19:30:24.622: INFO @log_variables: train gender_confidence/loss nanmean: 0.067798 2021-03-09 19:30:24.622: INFO @log_variables: train gender_confidence/accuracy mean: 0.790437 2021-03-09 19:30:24.622: INFO @log_variables: train age_confidence/loss mean: 0.060257 2021-03-09 19:30:24.622: INFO @log_variables: train age_confidence/accuracy mean: 0.659216 2021-03-09 19:30:24.622: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:30:24.624: INFO @metrics_hook: train age_mae: 7.942 +-0.140 (13824) 2021-03-09 19:30:24.627: INFO @metrics_hook: train gender_accuracy: 0.894 +-0.005 (13824) 2021-03-09 19:30:27.514: INFO @decay_lr : LR updated to `5.4846027e-05` 2021-03-09 19:30:27.516: INFO @log_profile : T train: 20.396025 2021-03-09 19:30:27.516: INFO @log_profile : T read data: 0.473063 2021-03-09 19:30:27.516: INFO @log_profile : T hooks: 3.421351 2021-03-09 19:30:27.516: INFO @main_loop : Epoch 339 done 2021-03-09 19:30:27.516: INFO @main_loop : Training epoch 340 2021-03-09 19:30:47.486: INFO @log_variables: train loss nanmean: 1.127290 2021-03-09 19:30:47.486: INFO @log_variables: train age_loss mean: 8.529994 2021-03-09 19:30:47.486: INFO @log_variables: train gender_loss mean: 0.247719 2021-03-09 19:30:47.486: INFO @log_variables: train age_mae mean: 7.983380 2021-03-09 19:30:47.487: INFO @log_variables: train gender_accuracy mean: 0.895255 2021-03-09 19:30:47.487: INFO @log_variables: train gender_confidence/loss nanmean: 0.067011 2021-03-09 19:30:47.487: INFO @log_variables: train gender_confidence/accuracy mean: 0.795356 2021-03-09 19:30:47.487: INFO @log_variables: train age_confidence/loss mean: 0.059626 2021-03-09 19:30:47.487: INFO @log_variables: train age_confidence/accuracy mean: 0.661820 2021-03-09 19:30:47.487: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:30:47.489: INFO @metrics_hook: train age_mae: 7.983 +-0.138 (13824) 2021-03-09 19:30:47.493: INFO @metrics_hook: train gender_accuracy: 0.895 +-0.005 (13824) 2021-03-09 19:30:49.972: INFO @decay_lr : LR updated to `5.4571796e-05` 2021-03-09 19:30:49.974: INFO @log_profile : T train: 18.824755 2021-03-09 19:30:49.975: INFO @log_profile : T read data: 0.522327 2021-03-09 19:30:49.975: INFO @log_profile : T hooks: 3.053769 2021-03-09 19:30:49.975: INFO @main_loop : Epoch 340 done 2021-03-09 19:30:49.975: INFO @main_loop : Training epoch 341 2021-03-09 19:31:09.868: INFO @log_variables: train loss nanmean: 1.123759 2021-03-09 19:31:09.868: INFO @log_variables: train age_loss mean: 8.548830 2021-03-09 19:31:09.868: INFO @log_variables: train gender_loss mean: 0.240885 2021-03-09 19:31:09.869: INFO @log_variables: train age_mae mean: 8.002516 2021-03-09 19:31:09.869: INFO @log_variables: train gender_accuracy mean: 0.901403 2021-03-09 19:31:09.869: INFO @log_variables: train gender_confidence/loss nanmean: 0.067659 2021-03-09 19:31:09.869: INFO @log_variables: train gender_confidence/accuracy mean: 0.796513 2021-03-09 19:31:09.869: INFO @log_variables: train age_confidence/loss mean: 0.059947 2021-03-09 19:31:09.869: INFO @log_variables: train age_confidence/accuracy mean: 0.663990 2021-03-09 19:31:09.869: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:31:09.871: INFO @metrics_hook: train age_mae: 8.003 +-0.142 (13824) 2021-03-09 19:31:09.873: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:31:12.546: INFO @decay_lr : LR updated to `5.4298936e-05` 2021-03-09 19:31:12.547: INFO @log_profile : T train: 18.929022 2021-03-09 19:31:12.547: INFO @log_profile : T read data: 0.359448 2021-03-09 19:31:12.547: INFO @log_profile : T hooks: 3.227941 2021-03-09 19:31:12.547: INFO @main_loop : Epoch 341 done 2021-03-09 19:31:12.548: INFO @main_loop : Training epoch 342 2021-03-09 19:31:32.213: INFO @log_variables: train loss nanmean: 1.128820 2021-03-09 19:31:32.213: INFO @log_variables: train age_loss mean: 8.600502 2021-03-09 19:31:32.213: INFO @log_variables: train gender_loss mean: 0.242248 2021-03-09 19:31:32.213: INFO @log_variables: train age_mae mean: 8.050172 2021-03-09 19:31:32.213: INFO @log_variables: train gender_accuracy mean: 0.900318 2021-03-09 19:31:32.213: INFO @log_variables: train gender_confidence/loss nanmean: 0.067190 2021-03-09 19:31:32.213: INFO @log_variables: train gender_confidence/accuracy mean: 0.796803 2021-03-09 19:31:32.213: INFO @log_variables: train age_confidence/loss mean: 0.059540 2021-03-09 19:31:32.213: INFO @log_variables: train age_confidence/accuracy mean: 0.663845 2021-03-09 19:31:32.214: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:31:32.215: INFO @metrics_hook: train age_mae: 8.050 +-0.140 (13824) 2021-03-09 19:31:32.217: INFO @metrics_hook: train gender_accuracy: 0.900 +-0.005 (13824) 2021-03-09 19:31:34.685: INFO @decay_lr : LR updated to `5.402744e-05` 2021-03-09 19:31:34.687: INFO @log_profile : T train: 18.714581 2021-03-09 19:31:34.687: INFO @log_profile : T read data: 0.369271 2021-03-09 19:31:34.687: INFO @log_profile : T hooks: 2.997851 2021-03-09 19:31:34.687: INFO @main_loop : Epoch 342 done 2021-03-09 19:31:34.687: INFO @main_loop : Training epoch 343 2021-03-09 19:31:54.628: INFO @log_variables: train loss nanmean: 1.117423 2021-03-09 19:31:54.629: INFO @log_variables: train age_loss mean: 8.519803 2021-03-09 19:31:54.629: INFO @log_variables: train gender_loss mean: 0.238606 2021-03-09 19:31:54.629: INFO @log_variables: train age_mae mean: 7.972791 2021-03-09 19:31:54.629: INFO @log_variables: train gender_accuracy mean: 0.902988 2021-03-09 19:31:54.629: INFO @log_variables: train gender_confidence/loss nanmean: 0.066093 2021-03-09 19:31:54.629: INFO @log_variables: train gender_confidence/accuracy mean: 0.805180 2021-03-09 19:31:54.629: INFO @log_variables: train age_confidence/loss mean: 0.059888 2021-03-09 19:31:54.629: INFO @log_variables: train age_confidence/accuracy mean: 0.659191 2021-03-09 19:31:54.629: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:31:54.631: INFO @metrics_hook: train age_mae: 7.973 +-0.140 (13823) 2021-03-09 19:31:54.634: INFO @metrics_hook: train gender_accuracy: 0.903 +-0.005 (13823) 2021-03-09 19:31:57.221: INFO @decay_lr : LR updated to `5.3757303e-05` 2021-03-09 19:31:57.222: INFO @log_profile : T train: 18.830190 2021-03-09 19:31:57.222: INFO @log_profile : T read data: 0.514920 2021-03-09 19:31:57.222: INFO @log_profile : T hooks: 3.134373 2021-03-09 19:31:57.222: INFO @main_loop : Epoch 343 done 2021-03-09 19:31:57.222: INFO @main_loop : Training epoch 344 2021-03-09 19:32:17.668: INFO @log_variables: train loss nanmean: 1.127198 2021-03-09 19:32:17.668: INFO @log_variables: train age_loss mean: 8.592371 2021-03-09 19:32:17.668: INFO @log_variables: train gender_loss mean: 0.240478 2021-03-09 19:32:17.668: INFO @log_variables: train age_mae mean: 8.043005 2021-03-09 19:32:17.668: INFO @log_variables: train gender_accuracy mean: 0.901107 2021-03-09 19:32:17.668: INFO @log_variables: train gender_confidence/loss nanmean: 0.068168 2021-03-09 19:32:17.668: INFO @log_variables: train gender_confidence/accuracy mean: 0.798741 2021-03-09 19:32:17.669: INFO @log_variables: train age_confidence/loss mean: 0.059289 2021-03-09 19:32:17.669: INFO @log_variables: train age_confidence/accuracy mean: 0.664328 2021-03-09 19:32:17.669: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:32:17.670: INFO @metrics_hook: train age_mae: 8.043 +-0.140 (13823) 2021-03-09 19:32:17.672: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13823) 2021-03-09 19:32:26.432: INFO @decay_lr : LR updated to `5.348852e-05` 2021-03-09 19:32:26.434: INFO @log_profile : T train: 19.513725 2021-03-09 19:32:26.434: INFO @log_profile : T read data: 0.372248 2021-03-09 19:32:26.434: INFO @log_profile : T hooks: 9.266220 2021-03-09 19:32:26.434: INFO @main_loop : Epoch 344 done 2021-03-09 19:32:26.434: INFO @main_loop : Training epoch 345 2021-03-09 19:32:46.135: INFO @log_variables: train loss nanmean: 1.116331 2021-03-09 19:32:46.135: INFO @log_variables: train age_loss mean: 8.419875 2021-03-09 19:32:46.135: INFO @log_variables: train gender_loss mean: 0.245469 2021-03-09 19:32:46.135: INFO @log_variables: train age_mae mean: 7.875373 2021-03-09 19:32:46.136: INFO @log_variables: train gender_accuracy mean: 0.902271 2021-03-09 19:32:46.136: INFO @log_variables: train gender_confidence/loss nanmean: 0.067697 2021-03-09 19:32:46.136: INFO @log_variables: train gender_confidence/accuracy mean: 0.794199 2021-03-09 19:32:46.136: INFO @log_variables: train age_confidence/loss mean: 0.060036 2021-03-09 19:32:46.136: INFO @log_variables: train age_confidence/accuracy mean: 0.660880 2021-03-09 19:32:46.136: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:32:46.138: INFO @metrics_hook: train age_mae: 7.875 +-0.139 (13824) 2021-03-09 19:32:46.140: INFO @metrics_hook: train gender_accuracy: 0.902 +-0.005 (13824) 2021-03-09 19:32:48.398: INFO @decay_lr : LR updated to `5.3221076e-05` 2021-03-09 19:32:48.399: INFO @log_profile : T train: 18.745953 2021-03-09 19:32:48.400: INFO @log_profile : T read data: 0.388384 2021-03-09 19:32:48.400: INFO @log_profile : T hooks: 2.776483 2021-03-09 19:32:48.400: INFO @main_loop : Epoch 345 done 2021-03-09 19:32:48.400: INFO @main_loop : Training epoch 346 2021-03-09 19:33:07.857: INFO @log_variables: train loss nanmean: 1.106973 2021-03-09 19:33:07.857: INFO @log_variables: train age_loss mean: 8.367626 2021-03-09 19:33:07.857: INFO @log_variables: train gender_loss mean: 0.241043 2021-03-09 19:33:07.857: INFO @log_variables: train age_mae mean: 7.824778 2021-03-09 19:33:07.857: INFO @log_variables: train gender_accuracy mean: 0.900608 2021-03-09 19:33:07.857: INFO @log_variables: train gender_confidence/loss nanmean: 0.067450 2021-03-09 19:33:07.857: INFO @log_variables: train gender_confidence/accuracy mean: 0.796947 2021-03-09 19:33:07.858: INFO @log_variables: train age_confidence/loss mean: 0.059700 2021-03-09 19:33:07.858: INFO @log_variables: train age_confidence/accuracy mean: 0.666016 2021-03-09 19:33:07.858: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:33:07.859: INFO @metrics_hook: train age_mae: 7.825 +-0.137 (13824) 2021-03-09 19:33:07.861: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:33:10.305: INFO @decay_lr : LR updated to `5.2954972e-05` 2021-03-09 19:33:10.308: INFO @log_profile : T train: 18.427257 2021-03-09 19:33:10.308: INFO @log_profile : T read data: 0.501445 2021-03-09 19:33:10.308: INFO @log_profile : T hooks: 2.925641 2021-03-09 19:33:10.308: INFO @main_loop : Epoch 346 done 2021-03-09 19:33:10.308: INFO @main_loop : Training epoch 347 2021-03-09 19:33:29.013: INFO @log_variables: train loss nanmean: 1.125502 2021-03-09 19:33:29.013: INFO @log_variables: train age_loss mean: 8.494130 2021-03-09 19:33:29.013: INFO @log_variables: train gender_loss mean: 0.246573 2021-03-09 19:33:29.014: INFO @log_variables: train age_mae mean: 7.947577 2021-03-09 19:33:29.014: INFO @log_variables: train gender_accuracy mean: 0.898220 2021-03-09 19:33:29.014: INFO @log_variables: train gender_confidence/loss nanmean: 0.069705 2021-03-09 19:33:29.014: INFO @log_variables: train gender_confidence/accuracy mean: 0.791884 2021-03-09 19:33:29.014: INFO @log_variables: train age_confidence/loss mean: 0.059446 2021-03-09 19:33:29.014: INFO @log_variables: train age_confidence/accuracy mean: 0.665654 2021-03-09 19:33:29.014: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:33:29.016: INFO @metrics_hook: train age_mae: 7.948 +-0.136 (13824) 2021-03-09 19:33:29.018: INFO @metrics_hook: train gender_accuracy: 0.898 +-0.005 (13824) 2021-03-09 19:33:31.146: INFO @decay_lr : LR updated to `5.2690197e-05` 2021-03-09 19:33:31.148: INFO @log_profile : T train: 17.826527 2021-03-09 19:33:31.148: INFO @log_profile : T read data: 0.350072 2021-03-09 19:33:31.148: INFO @log_profile : T hooks: 2.611704 2021-03-09 19:33:31.148: INFO @main_loop : Epoch 347 done 2021-03-09 19:33:31.148: INFO @main_loop : Training epoch 348 2021-03-09 19:33:49.647: INFO @log_variables: train loss nanmean: 1.135198 2021-03-09 19:33:49.647: INFO @log_variables: train age_loss mean: 8.502946 2021-03-09 19:33:49.647: INFO @log_variables: train gender_loss mean: 0.256231 2021-03-09 19:33:49.647: INFO @log_variables: train age_mae mean: 7.955482 2021-03-09 19:33:49.647: INFO @log_variables: train gender_accuracy mean: 0.894307 2021-03-09 19:33:49.647: INFO @log_variables: train gender_confidence/loss nanmean: 0.069678 2021-03-09 19:33:49.647: INFO @log_variables: train gender_confidence/accuracy mean: 0.785285 2021-03-09 19:33:49.647: INFO @log_variables: train age_confidence/loss mean: 0.059587 2021-03-09 19:33:49.648: INFO @log_variables: train age_confidence/accuracy mean: 0.664400 2021-03-09 19:33:49.648: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:33:49.650: INFO @metrics_hook: train age_mae: 7.955 +-0.139 (13823) 2021-03-09 19:33:49.652: INFO @metrics_hook: train gender_accuracy: 0.894 +-0.005 (13823) 2021-03-09 19:33:51.618: INFO @decay_lr : LR updated to `5.2426745e-05` 2021-03-09 19:33:51.619: INFO @log_profile : T train: 17.615828 2021-03-09 19:33:51.619: INFO @log_profile : T read data: 0.318339 2021-03-09 19:33:51.619: INFO @log_profile : T hooks: 2.487177 2021-03-09 19:33:51.619: INFO @main_loop : Epoch 348 done 2021-03-09 19:33:51.619: INFO @main_loop : Training epoch 349 2021-03-09 19:34:10.011: INFO @log_variables: train loss nanmean: 1.115985 2021-03-09 19:34:10.011: INFO @log_variables: train age_loss mean: 8.471272 2021-03-09 19:34:10.011: INFO @log_variables: train gender_loss mean: 0.241065 2021-03-09 19:34:10.011: INFO @log_variables: train age_mae mean: 7.925061 2021-03-09 19:34:10.011: INFO @log_variables: train gender_accuracy mean: 0.902850 2021-03-09 19:34:10.012: INFO @log_variables: train gender_confidence/loss nanmean: 0.067188 2021-03-09 19:34:10.012: INFO @log_variables: train gender_confidence/accuracy mean: 0.801722 2021-03-09 19:34:10.012: INFO @log_variables: train age_confidence/loss mean: 0.059532 2021-03-09 19:34:10.012: INFO @log_variables: train age_confidence/accuracy mean: 0.668547 2021-03-09 19:34:10.012: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:34:10.013: INFO @metrics_hook: train age_mae: 7.925 +-0.139 (13824) 2021-03-09 19:34:10.014: INFO @metrics_hook: train gender_accuracy: 0.903 +-0.005 (13824) 2021-03-09 19:34:12.070: INFO @decay_lr : LR updated to `5.216461e-05` 2021-03-09 19:34:12.071: INFO @log_profile : T train: 17.405105 2021-03-09 19:34:12.072: INFO @log_profile : T read data: 0.432621 2021-03-09 19:34:12.072: INFO @log_profile : T hooks: 2.565342 2021-03-09 19:34:12.072: INFO @main_loop : Epoch 349 done 2021-03-09 19:34:12.072: INFO @main_loop : Training epoch 350 2021-03-09 19:34:30.150: INFO @log_variables: train loss nanmean: 1.136601 2021-03-09 19:34:30.150: INFO @log_variables: train age_loss mean: 8.673360 2021-03-09 19:34:30.150: INFO @log_variables: train gender_loss mean: 0.242589 2021-03-09 19:34:30.150: INFO @log_variables: train age_mae mean: 8.122904 2021-03-09 19:34:30.150: INFO @log_variables: train gender_accuracy mean: 0.899595 2021-03-09 19:34:30.151: INFO @log_variables: train gender_confidence/loss nanmean: 0.068140 2021-03-09 19:34:30.151: INFO @log_variables: train gender_confidence/accuracy mean: 0.795428 2021-03-09 19:34:30.151: INFO @log_variables: train age_confidence/loss mean: 0.059438 2021-03-09 19:34:30.151: INFO @log_variables: train age_confidence/accuracy mean: 0.665654 2021-03-09 19:34:30.151: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:34:30.153: INFO @metrics_hook: train age_mae: 8.123 +-0.141 (13824) 2021-03-09 19:34:30.155: INFO @metrics_hook: train gender_accuracy: 0.900 +-0.005 (13824) 2021-03-09 19:34:32.146: INFO @decay_lr : LR updated to `5.190379e-05` 2021-03-09 19:34:32.148: INFO @log_profile : T train: 17.223155 2021-03-09 19:34:32.148: INFO @log_profile : T read data: 0.309720 2021-03-09 19:34:32.148: INFO @log_profile : T hooks: 2.494632 2021-03-09 19:34:32.148: INFO @main_loop : Epoch 350 done 2021-03-09 19:34:32.148: INFO @main_loop : Training epoch 351 2021-03-09 19:34:51.146: INFO @log_variables: train loss nanmean: 1.124315 2021-03-09 19:34:51.146: INFO @log_variables: train age_loss mean: 8.475633 2021-03-09 19:34:51.146: INFO @log_variables: train gender_loss mean: 0.248434 2021-03-09 19:34:51.146: INFO @log_variables: train age_mae mean: 7.930249 2021-03-09 19:34:51.146: INFO @log_variables: train gender_accuracy mean: 0.900391 2021-03-09 19:34:51.146: INFO @log_variables: train gender_confidence/loss nanmean: 0.067657 2021-03-09 19:34:51.147: INFO @log_variables: train gender_confidence/accuracy mean: 0.794488 2021-03-09 19:34:51.147: INFO @log_variables: train age_confidence/loss mean: 0.060296 2021-03-09 19:34:51.147: INFO @log_variables: train age_confidence/accuracy mean: 0.662833 2021-03-09 19:34:51.147: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:34:51.149: INFO @metrics_hook: train age_mae: 7.930 +-0.140 (13824) 2021-03-09 19:34:51.151: INFO @metrics_hook: train gender_accuracy: 0.900 +-0.005 (13824) 2021-03-09 19:34:53.142: INFO @decay_lr : LR updated to `5.164427e-05` 2021-03-09 19:34:53.143: INFO @log_profile : T train: 18.113188 2021-03-09 19:34:53.143: INFO @log_profile : T read data: 0.310150 2021-03-09 19:34:53.143: INFO @log_profile : T hooks: 2.522011 2021-03-09 19:34:53.143: INFO @main_loop : Epoch 351 done 2021-03-09 19:34:53.143: INFO @main_loop : Training epoch 352 2021-03-09 19:35:12.635: INFO @log_variables: train loss nanmean: 1.112967 2021-03-09 19:35:12.636: INFO @log_variables: train age_loss mean: 8.479679 2021-03-09 19:35:12.636: INFO @log_variables: train gender_loss mean: 0.237019 2021-03-09 19:35:12.636: INFO @log_variables: train age_mae mean: 7.931797 2021-03-09 19:35:12.636: INFO @log_variables: train gender_accuracy mean: 0.901331 2021-03-09 19:35:12.636: INFO @log_variables: train gender_confidence/loss nanmean: 0.066601 2021-03-09 19:35:12.636: INFO @log_variables: train gender_confidence/accuracy mean: 0.797815 2021-03-09 19:35:12.636: INFO @log_variables: train age_confidence/loss mean: 0.060014 2021-03-09 19:35:12.636: INFO @log_variables: train age_confidence/accuracy mean: 0.660229 2021-03-09 19:35:12.636: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:35:12.638: INFO @metrics_hook: train age_mae: 7.932 +-0.139 (13824) 2021-03-09 19:35:12.640: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:35:15.125: INFO @decay_lr : LR updated to `5.138605e-05` 2021-03-09 19:35:15.127: INFO @log_profile : T train: 18.466699 2021-03-09 19:35:15.127: INFO @log_profile : T read data: 0.476881 2021-03-09 19:35:15.127: INFO @log_profile : T hooks: 2.987324 2021-03-09 19:35:15.127: INFO @main_loop : Epoch 352 done 2021-03-09 19:35:15.127: INFO @main_loop : Training epoch 353 2021-03-09 19:35:35.469: INFO @log_variables: train loss nanmean: 1.134297 2021-03-09 19:35:35.470: INFO @log_variables: train age_loss mean: 8.634513 2021-03-09 19:35:35.470: INFO @log_variables: train gender_loss mean: 0.245902 2021-03-09 19:35:35.470: INFO @log_variables: train age_mae mean: 8.085493 2021-03-09 19:35:35.470: INFO @log_variables: train gender_accuracy mean: 0.896774 2021-03-09 19:35:35.470: INFO @log_variables: train gender_confidence/loss nanmean: 0.066081 2021-03-09 19:35:35.470: INFO @log_variables: train gender_confidence/accuracy mean: 0.801794 2021-03-09 19:35:35.470: INFO @log_variables: train age_confidence/loss mean: 0.059712 2021-03-09 19:35:35.470: INFO @log_variables: train age_confidence/accuracy mean: 0.661386 2021-03-09 19:35:35.470: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:35:35.472: INFO @metrics_hook: train age_mae: 8.085 +-0.141 (13824) 2021-03-09 19:35:35.474: INFO @metrics_hook: train gender_accuracy: 0.897 +-0.005 (13824) 2021-03-09 19:35:38.127: INFO @decay_lr : LR updated to `5.1129122e-05` 2021-03-09 19:35:38.129: INFO @log_profile : T train: 19.353776 2021-03-09 19:35:38.129: INFO @log_profile : T read data: 0.397740 2021-03-09 19:35:38.129: INFO @log_profile : T hooks: 3.194398 2021-03-09 19:35:38.129: INFO @main_loop : Epoch 353 done 2021-03-09 19:35:38.129: INFO @main_loop : Training epoch 354 2021-03-09 19:35:59.306: INFO @log_variables: train loss nanmean: 1.133256 2021-03-09 19:35:59.307: INFO @log_variables: train age_loss mean: 8.573451 2021-03-09 19:35:59.307: INFO @log_variables: train gender_loss mean: 0.250194 2021-03-09 19:35:59.307: INFO @log_variables: train age_mae mean: 8.026718 2021-03-09 19:35:59.307: INFO @log_variables: train gender_accuracy mean: 0.897056 2021-03-09 19:35:59.307: INFO @log_variables: train gender_confidence/loss nanmean: 0.067244 2021-03-09 19:35:59.307: INFO @log_variables: train gender_confidence/accuracy mean: 0.793750 2021-03-09 19:35:59.307: INFO @log_variables: train age_confidence/loss mean: 0.059158 2021-03-09 19:35:59.307: INFO @log_variables: train age_confidence/accuracy mean: 0.667438 2021-03-09 19:35:59.307: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:35:59.309: INFO @metrics_hook: train age_mae: 8.027 +-0.140 (13823) 2021-03-09 19:35:59.311: INFO @metrics_hook: train gender_accuracy: 0.897 +-0.005 (13823) 2021-03-09 19:36:02.413: INFO @decay_lr : LR updated to `5.0873477e-05` 2021-03-09 19:36:02.416: INFO @log_profile : T train: 20.126810 2021-03-09 19:36:02.416: INFO @log_profile : T read data: 0.495542 2021-03-09 19:36:02.416: INFO @log_profile : T hooks: 3.607712 2021-03-09 19:36:02.416: INFO @main_loop : Epoch 354 done 2021-03-09 19:36:02.416: INFO @main_loop : Training epoch 355 2021-03-09 19:36:23.410: INFO @log_variables: train loss nanmean: 1.116276 2021-03-09 19:36:23.410: INFO @log_variables: train age_loss mean: 8.451044 2021-03-09 19:36:23.410: INFO @log_variables: train gender_loss mean: 0.242842 2021-03-09 19:36:23.410: INFO @log_variables: train age_mae mean: 7.906186 2021-03-09 19:36:23.410: INFO @log_variables: train gender_accuracy mean: 0.898220 2021-03-09 19:36:23.410: INFO @log_variables: train gender_confidence/loss nanmean: 0.066875 2021-03-09 19:36:23.411: INFO @log_variables: train gender_confidence/accuracy mean: 0.801432 2021-03-09 19:36:23.411: INFO @log_variables: train age_confidence/loss mean: 0.060359 2021-03-09 19:36:23.411: INFO @log_variables: train age_confidence/accuracy mean: 0.660663 2021-03-09 19:36:23.411: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:36:23.413: INFO @metrics_hook: train age_mae: 7.906 +-0.139 (13824) 2021-03-09 19:36:23.415: INFO @metrics_hook: train gender_accuracy: 0.898 +-0.005 (13824) 2021-03-09 19:36:25.941: INFO @decay_lr : LR updated to `5.061911e-05` 2021-03-09 19:36:25.943: INFO @log_profile : T train: 19.919097 2021-03-09 19:36:25.943: INFO @log_profile : T read data: 0.504245 2021-03-09 19:36:25.943: INFO @log_profile : T hooks: 3.038986 2021-03-09 19:36:25.943: INFO @main_loop : Epoch 355 done 2021-03-09 19:36:25.943: INFO @main_loop : Training epoch 356 2021-03-09 19:36:45.773: INFO @log_variables: train loss nanmean: 1.127565 2021-03-09 19:36:45.773: INFO @log_variables: train age_loss mean: 8.535417 2021-03-09 19:36:45.774: INFO @log_variables: train gender_loss mean: 0.245270 2021-03-09 19:36:45.774: INFO @log_variables: train age_mae mean: 7.990090 2021-03-09 19:36:45.774: INFO @log_variables: train gender_accuracy mean: 0.899089 2021-03-09 19:36:45.774: INFO @log_variables: train gender_confidence/loss nanmean: 0.068631 2021-03-09 19:36:45.774: INFO @log_variables: train gender_confidence/accuracy mean: 0.791811 2021-03-09 19:36:45.774: INFO @log_variables: train age_confidence/loss mean: 0.060014 2021-03-09 19:36:45.774: INFO @log_variables: train age_confidence/accuracy mean: 0.661024 2021-03-09 19:36:45.774: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:36:45.777: INFO @metrics_hook: train age_mae: 7.990 +-0.141 (13824) 2021-03-09 19:36:45.779: INFO @metrics_hook: train gender_accuracy: 0.899 +-0.005 (13824) 2021-03-09 19:36:48.138: INFO @decay_lr : LR updated to `5.0366016e-05` 2021-03-09 19:36:48.140: INFO @log_profile : T train: 18.744802 2021-03-09 19:36:48.140: INFO @log_profile : T read data: 0.474680 2021-03-09 19:36:48.140: INFO @log_profile : T hooks: 2.921554 2021-03-09 19:36:48.140: INFO @main_loop : Epoch 356 done 2021-03-09 19:36:48.140: INFO @main_loop : Training epoch 357 2021-03-09 19:37:07.774: INFO @log_variables: train loss nanmean: 1.113229 2021-03-09 19:37:07.774: INFO @log_variables: train age_loss mean: 8.470512 2021-03-09 19:37:07.774: INFO @log_variables: train gender_loss mean: 0.238549 2021-03-09 19:37:07.774: INFO @log_variables: train age_mae mean: 7.923975 2021-03-09 19:37:07.774: INFO @log_variables: train gender_accuracy mean: 0.901042 2021-03-09 19:37:07.774: INFO @log_variables: train gender_confidence/loss nanmean: 0.066296 2021-03-09 19:37:07.774: INFO @log_variables: train gender_confidence/accuracy mean: 0.800998 2021-03-09 19:37:07.775: INFO @log_variables: train age_confidence/loss mean: 0.060024 2021-03-09 19:37:07.775: INFO @log_variables: train age_confidence/accuracy mean: 0.660518 2021-03-09 19:37:07.775: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:37:07.777: INFO @metrics_hook: train age_mae: 7.924 +-0.139 (13824) 2021-03-09 19:37:07.779: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:37:10.261: INFO @decay_lr : LR updated to `5.0114184e-05` 2021-03-09 19:37:10.263: INFO @log_profile : T train: 18.654507 2021-03-09 19:37:10.263: INFO @log_profile : T read data: 0.352109 2021-03-09 19:37:10.263: INFO @log_profile : T hooks: 3.057805 2021-03-09 19:37:10.263: INFO @main_loop : Epoch 357 done 2021-03-09 19:37:10.263: INFO @main_loop : Training epoch 358 2021-03-09 19:37:29.856: INFO @log_variables: train loss nanmean: 1.119011 2021-03-09 19:37:29.857: INFO @log_variables: train age_loss mean: 8.503093 2021-03-09 19:37:29.857: INFO @log_variables: train gender_loss mean: 0.240787 2021-03-09 19:37:29.857: INFO @log_variables: train age_mae mean: 7.955277 2021-03-09 19:37:29.857: INFO @log_variables: train gender_accuracy mean: 0.901910 2021-03-09 19:37:29.857: INFO @log_variables: train gender_confidence/loss nanmean: 0.067104 2021-03-09 19:37:29.857: INFO @log_variables: train gender_confidence/accuracy mean: 0.798828 2021-03-09 19:37:29.857: INFO @log_variables: train age_confidence/loss mean: 0.060002 2021-03-09 19:37:29.857: INFO @log_variables: train age_confidence/accuracy mean: 0.661241 2021-03-09 19:37:29.857: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:37:29.859: INFO @metrics_hook: train age_mae: 7.955 +-0.140 (13824) 2021-03-09 19:37:29.861: INFO @metrics_hook: train gender_accuracy: 0.902 +-0.005 (13824) 2021-03-09 19:37:32.172: INFO @decay_lr : LR updated to `4.9863615e-05` 2021-03-09 19:37:32.175: INFO @log_profile : T train: 18.616825 2021-03-09 19:37:32.175: INFO @log_profile : T read data: 0.369119 2021-03-09 19:37:32.175: INFO @log_profile : T hooks: 2.870043 2021-03-09 19:37:32.175: INFO @main_loop : Epoch 358 done 2021-03-09 19:37:32.175: INFO @main_loop : Training epoch 359 2021-03-09 19:37:52.100: INFO @log_variables: train loss nanmean: 1.120690 2021-03-09 19:37:52.100: INFO @log_variables: train age_loss mean: 8.485186 2021-03-09 19:37:52.100: INFO @log_variables: train gender_loss mean: 0.244140 2021-03-09 19:37:52.101: INFO @log_variables: train age_mae mean: 7.939703 2021-03-09 19:37:52.101: INFO @log_variables: train gender_accuracy mean: 0.899306 2021-03-09 19:37:52.101: INFO @log_variables: train gender_confidence/loss nanmean: 0.067569 2021-03-09 19:37:52.101: INFO @log_variables: train gender_confidence/accuracy mean: 0.794416 2021-03-09 19:37:52.101: INFO @log_variables: train age_confidence/loss mean: 0.059795 2021-03-09 19:37:52.101: INFO @log_variables: train age_confidence/accuracy mean: 0.662399 2021-03-09 19:37:52.101: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:37:52.103: INFO @metrics_hook: train age_mae: 7.940 +-0.140 (13824) 2021-03-09 19:37:52.104: INFO @metrics_hook: train gender_accuracy: 0.899 +-0.005 (13824) 2021-03-09 19:37:54.384: INFO @decay_lr : LR updated to `4.9614297e-05` 2021-03-09 19:37:54.386: INFO @log_profile : T train: 18.802528 2021-03-09 19:37:54.386: INFO @log_profile : T read data: 0.499304 2021-03-09 19:37:54.386: INFO @log_profile : T hooks: 2.852605 2021-03-09 19:37:54.386: INFO @main_loop : Epoch 359 done 2021-03-09 19:37:54.386: INFO @main_loop : Training epoch 360 2021-03-09 19:38:14.647: INFO @log_variables: train loss nanmean: 1.108200 2021-03-09 19:38:14.649: INFO @log_variables: train age_loss mean: 8.411228 2021-03-09 19:38:14.652: INFO @log_variables: train gender_loss mean: 0.239190 2021-03-09 19:38:14.653: INFO @log_variables: train age_mae mean: 7.865802 2021-03-09 19:38:14.656: INFO @log_variables: train gender_accuracy mean: 0.898727 2021-03-09 19:38:14.658: INFO @log_variables: train gender_confidence/loss nanmean: 0.065530 2021-03-09 19:38:14.660: INFO @log_variables: train gender_confidence/accuracy mean: 0.799334 2021-03-09 19:38:14.661: INFO @log_variables: train age_confidence/loss mean: 0.060568 2021-03-09 19:38:14.661: INFO @log_variables: train age_confidence/accuracy mean: 0.656829 2021-03-09 19:38:14.661: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:38:14.663: INFO @metrics_hook: train age_mae: 7.866 +-0.137 (13824) 2021-03-09 19:38:14.665: INFO @metrics_hook: train gender_accuracy: 0.899 +-0.005 (13824) 2021-03-09 19:38:17.456: INFO @decay_lr : LR updated to `4.9366226e-05` 2021-03-09 19:38:17.459: INFO @log_profile : T train: 19.356871 2021-03-09 19:38:17.459: INFO @log_profile : T read data: 0.363383 2021-03-09 19:38:17.459: INFO @log_profile : T hooks: 3.301657 2021-03-09 19:38:17.459: INFO @main_loop : Epoch 360 done 2021-03-09 19:38:17.460: INFO @main_loop : Training epoch 361 2021-03-09 19:38:38.632: INFO @log_variables: train loss nanmean: 1.113624 2021-03-09 19:38:38.633: INFO @log_variables: train age_loss mean: 8.503434 2021-03-09 19:38:38.633: INFO @log_variables: train gender_loss mean: 0.236363 2021-03-09 19:38:38.633: INFO @log_variables: train age_mae mean: 7.959305 2021-03-09 19:38:38.633: INFO @log_variables: train gender_accuracy mean: 0.901620 2021-03-09 19:38:38.633: INFO @log_variables: train gender_confidence/loss nanmean: 0.065964 2021-03-09 19:38:38.633: INFO @log_variables: train gender_confidence/accuracy mean: 0.799696 2021-03-09 19:38:38.634: INFO @log_variables: train age_confidence/loss mean: 0.059745 2021-03-09 19:38:38.634: INFO @log_variables: train age_confidence/accuracy mean: 0.667752 2021-03-09 19:38:38.634: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:38:38.636: INFO @metrics_hook: train age_mae: 7.959 +-0.140 (13824) 2021-03-09 19:38:38.638: INFO @metrics_hook: train gender_accuracy: 0.902 +-0.005 (13824) 2021-03-09 19:38:41.509: INFO @decay_lr : LR updated to `4.9119397e-05` 2021-03-09 19:38:41.511: INFO @log_profile : T train: 20.112856 2021-03-09 19:38:41.511: INFO @log_profile : T read data: 0.483785 2021-03-09 19:38:41.511: INFO @log_profile : T hooks: 3.396974 2021-03-09 19:38:41.511: INFO @main_loop : Epoch 361 done 2021-03-09 19:38:41.511: INFO @main_loop : Training epoch 362 2021-03-09 19:39:02.451: INFO @log_variables: train loss nanmean: 1.106508 2021-03-09 19:39:02.451: INFO @log_variables: train age_loss mean: 8.359935 2021-03-09 19:39:02.452: INFO @log_variables: train gender_loss mean: 0.240599 2021-03-09 19:39:02.452: INFO @log_variables: train age_mae mean: 7.817614 2021-03-09 19:39:02.452: INFO @log_variables: train gender_accuracy mean: 0.900969 2021-03-09 19:39:02.452: INFO @log_variables: train gender_confidence/loss nanmean: 0.067198 2021-03-09 19:39:02.452: INFO @log_variables: train gender_confidence/accuracy mean: 0.797381 2021-03-09 19:39:02.452: INFO @log_variables: train age_confidence/loss mean: 0.060589 2021-03-09 19:39:02.452: INFO @log_variables: train age_confidence/accuracy mean: 0.664497 2021-03-09 19:39:02.453: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:39:02.456: INFO @metrics_hook: train age_mae: 7.818 +-0.139 (13824) 2021-03-09 19:39:02.459: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:39:05.145: INFO @decay_lr : LR updated to `4.88738e-05` 2021-03-09 19:39:05.148: INFO @log_profile : T train: 19.787958 2021-03-09 19:39:05.148: INFO @log_profile : T read data: 0.566873 2021-03-09 19:39:05.148: INFO @log_profile : T hooks: 3.224109 2021-03-09 19:39:05.149: INFO @main_loop : Epoch 362 done 2021-03-09 19:39:05.149: INFO @main_loop : Training epoch 363 2021-03-09 19:39:27.688: INFO @log_variables: train loss nanmean: 1.097697 2021-03-09 19:39:27.693: INFO @log_variables: train age_loss mean: 8.333658 2021-03-09 19:39:27.693: INFO @log_variables: train gender_loss mean: 0.235692 2021-03-09 19:39:27.693: INFO @log_variables: train age_mae mean: 7.790904 2021-03-09 19:39:27.693: INFO @log_variables: train gender_accuracy mean: 0.903791 2021-03-09 19:39:27.693: INFO @log_variables: train gender_confidence/loss nanmean: 0.065194 2021-03-09 19:39:27.694: INFO @log_variables: train gender_confidence/accuracy mean: 0.802228 2021-03-09 19:39:27.694: INFO @log_variables: train age_confidence/loss mean: 0.060632 2021-03-09 19:39:27.694: INFO @log_variables: train age_confidence/accuracy mean: 0.661241 2021-03-09 19:39:27.694: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:39:27.696: INFO @metrics_hook: train age_mae: 7.791 +-0.137 (13824) 2021-03-09 19:39:27.697: INFO @metrics_hook: train gender_accuracy: 0.904 +-0.005 (13824) 2021-03-09 19:39:31.176: INFO @decay_lr : LR updated to `4.862943e-05` 2021-03-09 19:39:31.181: INFO @log_profile : T train: 21.540315 2021-03-09 19:39:31.184: INFO @log_profile : T read data: 0.460041 2021-03-09 19:39:31.185: INFO @log_profile : T hooks: 3.977516 2021-03-09 19:39:31.187: INFO @main_loop : Epoch 363 done 2021-03-09 19:39:31.189: INFO @main_loop : Training epoch 364 2021-03-09 19:39:52.945: INFO @log_variables: train loss nanmean: 1.120732 2021-03-09 19:39:52.946: INFO @log_variables: train age_loss mean: 8.436543 2021-03-09 19:39:52.946: INFO @log_variables: train gender_loss mean: 0.249326 2021-03-09 19:39:52.946: INFO @log_variables: train age_mae mean: 7.891321 2021-03-09 19:39:52.946: INFO @log_variables: train gender_accuracy mean: 0.896774 2021-03-09 19:39:52.946: INFO @log_variables: train gender_confidence/loss nanmean: 0.066589 2021-03-09 19:39:52.946: INFO @log_variables: train gender_confidence/accuracy mean: 0.799551 2021-03-09 19:39:52.946: INFO @log_variables: train age_confidence/loss mean: 0.060525 2021-03-09 19:39:52.946: INFO @log_variables: train age_confidence/accuracy mean: 0.657697 2021-03-09 19:39:52.946: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:39:52.948: INFO @metrics_hook: train age_mae: 7.891 +-0.138 (13824) 2021-03-09 19:39:52.950: INFO @metrics_hook: train gender_accuracy: 0.897 +-0.005 (13824) 2021-03-09 19:39:55.789: INFO @decay_lr : LR updated to `4.8386282e-05` 2021-03-09 19:39:55.791: INFO @log_profile : T train: 20.753348 2021-03-09 19:39:55.791: INFO @log_profile : T read data: 0.420816 2021-03-09 19:39:55.791: INFO @log_profile : T hooks: 3.367651 2021-03-09 19:39:55.791: INFO @main_loop : Epoch 364 done 2021-03-09 19:39:55.791: INFO @main_loop : Training epoch 365 2021-03-09 19:40:16.414: INFO @log_variables: train loss nanmean: 1.117814 2021-03-09 19:40:16.415: INFO @log_variables: train age_loss mean: 8.412003 2021-03-09 19:40:16.415: INFO @log_variables: train gender_loss mean: 0.247143 2021-03-09 19:40:16.415: INFO @log_variables: train age_mae mean: 7.866101 2021-03-09 19:40:16.415: INFO @log_variables: train gender_accuracy mean: 0.897208 2021-03-09 19:40:16.415: INFO @log_variables: train gender_confidence/loss nanmean: 0.068010 2021-03-09 19:40:16.415: INFO @log_variables: train gender_confidence/accuracy mean: 0.791594 2021-03-09 19:40:16.415: INFO @log_variables: train age_confidence/loss mean: 0.060401 2021-03-09 19:40:16.415: INFO @log_variables: train age_confidence/accuracy mean: 0.660229 2021-03-09 19:40:16.415: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:40:16.417: INFO @metrics_hook: train age_mae: 7.866 +-0.135 (13824) 2021-03-09 19:40:16.419: INFO @metrics_hook: train gender_accuracy: 0.897 +-0.005 (13824) 2021-03-09 19:40:19.173: INFO @decay_lr : LR updated to `4.814435e-05` 2021-03-09 19:40:19.176: INFO @log_profile : T train: 19.426388 2021-03-09 19:40:19.176: INFO @log_profile : T read data: 0.598287 2021-03-09 19:40:19.176: INFO @log_profile : T hooks: 3.296236 2021-03-09 19:40:19.176: INFO @main_loop : Epoch 365 done 2021-03-09 19:40:19.177: INFO @main_loop : Training epoch 366 2021-03-09 19:40:39.761: INFO @log_variables: train loss nanmean: 1.111732 2021-03-09 19:40:39.761: INFO @log_variables: train age_loss mean: 8.376555 2021-03-09 19:40:39.761: INFO @log_variables: train gender_loss mean: 0.244110 2021-03-09 19:40:39.761: INFO @log_variables: train age_mae mean: 7.835208 2021-03-09 19:40:39.761: INFO @log_variables: train gender_accuracy mean: 0.899450 2021-03-09 19:40:39.761: INFO @log_variables: train gender_confidence/loss nanmean: 0.068271 2021-03-09 19:40:39.761: INFO @log_variables: train gender_confidence/accuracy mean: 0.793258 2021-03-09 19:40:39.762: INFO @log_variables: train age_confidence/loss mean: 0.060039 2021-03-09 19:40:39.762: INFO @log_variables: train age_confidence/accuracy mean: 0.661965 2021-03-09 19:40:39.762: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:40:39.764: INFO @metrics_hook: train age_mae: 7.835 +-0.137 (13824) 2021-03-09 19:40:39.767: INFO @metrics_hook: train gender_accuracy: 0.899 +-0.005 (13824) 2021-03-09 19:40:42.279: INFO @decay_lr : LR updated to `4.7903628e-05` 2021-03-09 19:40:42.281: INFO @log_profile : T train: 19.601429 2021-03-09 19:40:42.281: INFO @log_profile : T read data: 0.432882 2021-03-09 19:40:42.281: INFO @log_profile : T hooks: 3.015219 2021-03-09 19:40:42.281: INFO @main_loop : Epoch 366 done 2021-03-09 19:40:42.281: INFO @main_loop : Training epoch 367 2021-03-09 19:41:02.728: INFO @log_variables: train loss nanmean: 1.101246 2021-03-09 19:41:02.729: INFO @log_variables: train age_loss mean: 8.339709 2021-03-09 19:41:02.729: INFO @log_variables: train gender_loss mean: 0.235773 2021-03-09 19:41:02.729: INFO @log_variables: train age_mae mean: 7.798836 2021-03-09 19:41:02.729: INFO @log_variables: train gender_accuracy mean: 0.905744 2021-03-09 19:41:02.729: INFO @log_variables: train gender_confidence/loss nanmean: 0.068673 2021-03-09 19:41:02.729: INFO @log_variables: train gender_confidence/accuracy mean: 0.797164 2021-03-09 19:41:02.729: INFO @log_variables: train age_confidence/loss mean: 0.060079 2021-03-09 19:41:02.729: INFO @log_variables: train age_confidence/accuracy mean: 0.666160 2021-03-09 19:41:02.729: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:41:02.731: INFO @metrics_hook: train age_mae: 7.799 +-0.135 (13824) 2021-03-09 19:41:02.733: INFO @metrics_hook: train gender_accuracy: 0.906 +-0.005 (13824) 2021-03-09 19:41:05.351: INFO @decay_lr : LR updated to `4.766411e-05` 2021-03-09 19:41:05.353: INFO @log_profile : T train: 19.441212 2021-03-09 19:41:05.354: INFO @log_profile : T read data: 0.428394 2021-03-09 19:41:05.354: INFO @log_profile : T hooks: 3.146434 2021-03-09 19:41:05.354: INFO @main_loop : Epoch 367 done 2021-03-09 19:41:05.354: INFO @main_loop : Training epoch 368 2021-03-09 19:41:25.281: INFO @log_variables: train loss nanmean: 1.122520 2021-03-09 19:41:25.281: INFO @log_variables: train age_loss mean: 8.531848 2021-03-09 19:41:25.281: INFO @log_variables: train gender_loss mean: 0.241000 2021-03-09 19:41:25.281: INFO @log_variables: train age_mae mean: 7.983596 2021-03-09 19:41:25.281: INFO @log_variables: train gender_accuracy mean: 0.901910 2021-03-09 19:41:25.281: INFO @log_variables: train gender_confidence/loss nanmean: 0.068259 2021-03-09 19:41:25.281: INFO @log_variables: train gender_confidence/accuracy mean: 0.793837 2021-03-09 19:41:25.281: INFO @log_variables: train age_confidence/loss mean: 0.059548 2021-03-09 19:41:25.282: INFO @log_variables: train age_confidence/accuracy mean: 0.666956 2021-03-09 19:41:25.282: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:41:25.284: INFO @metrics_hook: train age_mae: 7.984 +-0.141 (13824) 2021-03-09 19:41:25.286: INFO @metrics_hook: train gender_accuracy: 0.902 +-0.005 (13824) 2021-03-09 19:41:27.603: INFO @decay_lr : LR updated to `4.742579e-05` 2021-03-09 19:41:27.605: INFO @log_profile : T train: 18.830512 2021-03-09 19:41:27.606: INFO @log_profile : T read data: 0.483249 2021-03-09 19:41:27.606: INFO @log_profile : T hooks: 2.882938 2021-03-09 19:41:27.606: INFO @main_loop : Epoch 368 done 2021-03-09 19:41:27.606: INFO @main_loop : Training epoch 369 2021-03-09 19:41:48.438: INFO @log_variables: train loss nanmean: 1.105425 2021-03-09 19:41:48.438: INFO @log_variables: train age_loss mean: 8.377316 2021-03-09 19:41:48.438: INFO @log_variables: train gender_loss mean: 0.236986 2021-03-09 19:41:48.438: INFO @log_variables: train age_mae mean: 7.835072 2021-03-09 19:41:48.438: INFO @log_variables: train gender_accuracy mean: 0.903067 2021-03-09 19:41:48.438: INFO @log_variables: train gender_confidence/loss nanmean: 0.068484 2021-03-09 19:41:48.439: INFO @log_variables: train gender_confidence/accuracy mean: 0.795501 2021-03-09 19:41:48.439: INFO @log_variables: train age_confidence/loss mean: 0.059926 2021-03-09 19:41:48.439: INFO @log_variables: train age_confidence/accuracy mean: 0.666667 2021-03-09 19:41:48.439: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:41:48.441: INFO @metrics_hook: train age_mae: 7.835 +-0.136 (13824) 2021-03-09 19:41:48.443: INFO @metrics_hook: train gender_accuracy: 0.903 +-0.005 (13824) 2021-03-09 19:41:51.417: INFO @decay_lr : LR updated to `4.718866e-05` 2021-03-09 19:41:51.418: INFO @log_profile : T train: 19.832506 2021-03-09 19:41:51.418: INFO @log_profile : T read data: 0.402288 2021-03-09 19:41:51.418: INFO @log_profile : T hooks: 3.518074 2021-03-09 19:41:51.419: INFO @main_loop : Epoch 369 done 2021-03-09 19:41:51.419: INFO @main_loop : Training epoch 370 2021-03-09 19:42:13.085: INFO @log_variables: train loss nanmean: 1.112190 2021-03-09 19:42:13.088: INFO @log_variables: train age_loss mean: 8.381507 2021-03-09 19:42:13.089: INFO @log_variables: train gender_loss mean: 0.244993 2021-03-09 19:42:13.091: INFO @log_variables: train age_mae mean: 7.837588 2021-03-09 19:42:13.093: INFO @log_variables: train gender_accuracy mean: 0.898003 2021-03-09 19:42:13.095: INFO @log_variables: train gender_confidence/loss nanmean: 0.067342 2021-03-09 19:42:13.096: INFO @log_variables: train gender_confidence/accuracy mean: 0.794777 2021-03-09 19:42:13.096: INFO @log_variables: train age_confidence/loss mean: 0.060173 2021-03-09 19:42:13.096: INFO @log_variables: train age_confidence/accuracy mean: 0.664062 2021-03-09 19:42:13.096: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:42:13.098: INFO @metrics_hook: train age_mae: 7.838 +-0.137 (13824) 2021-03-09 19:42:13.100: INFO @metrics_hook: train gender_accuracy: 0.898 +-0.005 (13824) 2021-03-09 19:42:15.969: INFO @decay_lr : LR updated to `4.6952715e-05` 2021-03-09 19:42:15.971: INFO @log_profile : T train: 20.721191 2021-03-09 19:42:15.971: INFO @log_profile : T read data: 0.420566 2021-03-09 19:42:15.971: INFO @log_profile : T hooks: 3.357415 2021-03-09 19:42:15.972: INFO @main_loop : Epoch 370 done 2021-03-09 19:42:15.972: INFO @main_loop : Training epoch 371 2021-03-09 19:42:37.459: INFO @log_variables: train loss nanmean: 1.102978 2021-03-09 19:42:37.461: INFO @log_variables: train age_loss mean: 8.291935 2021-03-09 19:42:37.462: INFO @log_variables: train gender_loss mean: 0.243052 2021-03-09 19:42:37.465: INFO @log_variables: train age_mae mean: 7.751315 2021-03-09 19:42:37.466: INFO @log_variables: train gender_accuracy mean: 0.901476 2021-03-09 19:42:37.468: INFO @log_variables: train gender_confidence/loss nanmean: 0.067568 2021-03-09 19:42:37.470: INFO @log_variables: train gender_confidence/accuracy mean: 0.795067 2021-03-09 19:42:37.470: INFO @log_variables: train age_confidence/loss mean: 0.060642 2021-03-09 19:42:37.471: INFO @log_variables: train age_confidence/accuracy mean: 0.655816 2021-03-09 19:42:37.471: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:42:37.473: INFO @metrics_hook: train age_mae: 7.751 +-0.136 (13824) 2021-03-09 19:42:37.476: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:42:40.490: INFO @decay_lr : LR updated to `4.6717953e-05` 2021-03-09 19:42:40.492: INFO @log_profile : T train: 20.454867 2021-03-09 19:42:40.493: INFO @log_profile : T read data: 0.485940 2021-03-09 19:42:40.493: INFO @log_profile : T hooks: 3.525003 2021-03-09 19:42:40.493: INFO @main_loop : Epoch 371 done 2021-03-09 19:42:40.493: INFO @main_loop : Training epoch 372 2021-03-09 19:43:01.427: INFO @log_variables: train loss nanmean: 1.107822 2021-03-09 19:43:01.427: INFO @log_variables: train age_loss mean: 8.428337 2021-03-09 19:43:01.427: INFO @log_variables: train gender_loss mean: 0.236753 2021-03-09 19:43:01.427: INFO @log_variables: train age_mae mean: 7.883506 2021-03-09 19:43:01.427: INFO @log_variables: train gender_accuracy mean: 0.903212 2021-03-09 19:43:01.427: INFO @log_variables: train gender_confidence/loss nanmean: 0.065705 2021-03-09 19:43:01.428: INFO @log_variables: train gender_confidence/accuracy mean: 0.806568 2021-03-09 19:43:01.428: INFO @log_variables: train age_confidence/loss mean: 0.060674 2021-03-09 19:43:01.428: INFO @log_variables: train age_confidence/accuracy mean: 0.659795 2021-03-09 19:43:01.428: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:43:01.430: INFO @metrics_hook: train age_mae: 7.884 +-0.141 (13824) 2021-03-09 19:43:01.431: INFO @metrics_hook: train gender_accuracy: 0.903 +-0.005 (13824) 2021-03-09 19:43:03.897: INFO @decay_lr : LR updated to `4.648436e-05` 2021-03-09 19:43:03.898: INFO @log_profile : T train: 19.741742 2021-03-09 19:43:03.898: INFO @log_profile : T read data: 0.629954 2021-03-09 19:43:03.898: INFO @log_profile : T hooks: 2.976042 2021-03-09 19:43:03.898: INFO @main_loop : Epoch 372 done 2021-03-09 19:43:03.898: INFO @main_loop : Training epoch 373 2021-03-09 19:43:22.920: INFO @log_variables: train loss nanmean: 1.115441 2021-03-09 19:43:22.920: INFO @log_variables: train age_loss mean: 8.462757 2021-03-09 19:43:22.920: INFO @log_variables: train gender_loss mean: 0.243213 2021-03-09 19:43:22.920: INFO @log_variables: train age_mae mean: 7.917246 2021-03-09 19:43:22.920: INFO @log_variables: train gender_accuracy mean: 0.897063 2021-03-09 19:43:22.920: INFO @log_variables: train gender_confidence/loss nanmean: 0.064565 2021-03-09 19:43:22.920: INFO @log_variables: train gender_confidence/accuracy mean: 0.799118 2021-03-09 19:43:22.920: INFO @log_variables: train age_confidence/loss mean: 0.060432 2021-03-09 19:43:22.920: INFO @log_variables: train age_confidence/accuracy mean: 0.659288 2021-03-09 19:43:22.920: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:43:22.922: INFO @metrics_hook: train age_mae: 7.917 +-0.140 (13824) 2021-03-09 19:43:22.924: INFO @metrics_hook: train gender_accuracy: 0.897 +-0.005 (13824) 2021-03-09 19:43:24.895: INFO @decay_lr : LR updated to `4.625194e-05` 2021-03-09 19:43:24.898: INFO @log_profile : T train: 18.130403 2021-03-09 19:43:24.898: INFO @log_profile : T read data: 0.322510 2021-03-09 19:43:24.898: INFO @log_profile : T hooks: 2.496080 2021-03-09 19:43:24.898: INFO @main_loop : Epoch 373 done 2021-03-09 19:43:24.898: INFO @main_loop : Training epoch 374 2021-03-09 19:43:43.892: INFO @log_variables: train loss nanmean: 1.097077 2021-03-09 19:43:43.892: INFO @log_variables: train age_loss mean: 8.369015 2021-03-09 19:43:43.892: INFO @log_variables: train gender_loss mean: 0.230597 2021-03-09 19:43:43.892: INFO @log_variables: train age_mae mean: 7.827545 2021-03-09 19:43:43.892: INFO @log_variables: train gender_accuracy mean: 0.904876 2021-03-09 19:43:43.892: INFO @log_variables: train gender_confidence/loss nanmean: 0.066408 2021-03-09 19:43:43.892: INFO @log_variables: train gender_confidence/accuracy mean: 0.809028 2021-03-09 19:43:43.893: INFO @log_variables: train age_confidence/loss mean: 0.060216 2021-03-09 19:43:43.893: INFO @log_variables: train age_confidence/accuracy mean: 0.660663 2021-03-09 19:43:43.893: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:43:43.894: INFO @metrics_hook: train age_mae: 7.828 +-0.137 (13824) 2021-03-09 19:43:43.895: INFO @metrics_hook: train gender_accuracy: 0.905 +-0.005 (13824) 2021-03-09 19:43:46.001: INFO @decay_lr : LR updated to `4.602068e-05` 2021-03-09 19:43:46.002: INFO @log_profile : T train: 18.144107 2021-03-09 19:43:46.003: INFO @log_profile : T read data: 0.298614 2021-03-09 19:43:46.003: INFO @log_profile : T hooks: 2.612797 2021-03-09 19:43:46.003: INFO @main_loop : Epoch 374 done 2021-03-09 19:43:46.003: INFO @main_loop : Training epoch 375 2021-03-09 19:44:05.234: INFO @log_variables: train loss nanmean: 1.108428 2021-03-09 19:44:05.234: INFO @log_variables: train age_loss mean: 8.369329 2021-03-09 19:44:05.234: INFO @log_variables: train gender_loss mean: 0.241542 2021-03-09 19:44:05.234: INFO @log_variables: train age_mae mean: 7.826101 2021-03-09 19:44:05.234: INFO @log_variables: train gender_accuracy mean: 0.899884 2021-03-09 19:44:05.234: INFO @log_variables: train gender_confidence/loss nanmean: 0.067521 2021-03-09 19:44:05.235: INFO @log_variables: train gender_confidence/accuracy mean: 0.800492 2021-03-09 19:44:05.235: INFO @log_variables: train age_confidence/loss mean: 0.060475 2021-03-09 19:44:05.235: INFO @log_variables: train age_confidence/accuracy mean: 0.659795 2021-03-09 19:44:05.235: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:44:05.237: INFO @metrics_hook: train age_mae: 7.826 +-0.138 (13824) 2021-03-09 19:44:05.238: INFO @metrics_hook: train gender_accuracy: 0.900 +-0.005 (13824) 2021-03-09 19:44:07.298: INFO @decay_lr : LR updated to `4.5790577e-05` 2021-03-09 19:44:07.299: INFO @log_profile : T train: 18.207521 2021-03-09 19:44:07.299: INFO @log_profile : T read data: 0.454321 2021-03-09 19:44:07.299: INFO @log_profile : T hooks: 2.584163 2021-03-09 19:44:07.299: INFO @main_loop : Epoch 375 done 2021-03-09 19:44:07.299: INFO @main_loop : Training epoch 376 2021-03-09 19:44:26.324: INFO @log_variables: train loss nanmean: 1.100672 2021-03-09 19:44:26.324: INFO @log_variables: train age_loss mean: 8.362144 2021-03-09 19:44:26.324: INFO @log_variables: train gender_loss mean: 0.235093 2021-03-09 19:44:26.324: INFO @log_variables: train age_mae mean: 7.818085 2021-03-09 19:44:26.324: INFO @log_variables: train gender_accuracy mean: 0.900535 2021-03-09 19:44:26.324: INFO @log_variables: train gender_confidence/loss nanmean: 0.066383 2021-03-09 19:44:26.324: INFO @log_variables: train gender_confidence/accuracy mean: 0.796658 2021-03-09 19:44:26.324: INFO @log_variables: train age_confidence/loss mean: 0.060374 2021-03-09 19:44:26.324: INFO @log_variables: train age_confidence/accuracy mean: 0.660373 2021-03-09 19:44:26.324: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:44:26.327: INFO @metrics_hook: train age_mae: 7.818 +-0.139 (13824) 2021-03-09 19:44:26.329: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:44:28.316: INFO @decay_lr : LR updated to `4.5561625e-05` 2021-03-09 19:44:28.318: INFO @log_profile : T train: 18.117366 2021-03-09 19:44:28.318: INFO @log_profile : T read data: 0.334753 2021-03-09 19:44:28.318: INFO @log_profile : T hooks: 2.514802 2021-03-09 19:44:28.318: INFO @main_loop : Epoch 376 done 2021-03-09 19:44:28.318: INFO @main_loop : Training epoch 377 2021-03-09 19:44:47.538: INFO @log_variables: train loss nanmean: 1.111380 2021-03-09 19:44:47.538: INFO @log_variables: train age_loss mean: 8.413466 2021-03-09 19:44:47.538: INFO @log_variables: train gender_loss mean: 0.241036 2021-03-09 19:44:47.538: INFO @log_variables: train age_mae mean: 7.868307 2021-03-09 19:44:47.538: INFO @log_variables: train gender_accuracy mean: 0.900969 2021-03-09 19:44:47.538: INFO @log_variables: train gender_confidence/loss nanmean: 0.067244 2021-03-09 19:44:47.539: INFO @log_variables: train gender_confidence/accuracy mean: 0.797309 2021-03-09 19:44:47.539: INFO @log_variables: train age_confidence/loss mean: 0.060151 2021-03-09 19:44:47.539: INFO @log_variables: train age_confidence/accuracy mean: 0.662399 2021-03-09 19:44:47.539: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:44:47.540: INFO @metrics_hook: train age_mae: 7.868 +-0.137 (13824) 2021-03-09 19:44:47.541: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:44:50.048: INFO @decay_lr : LR updated to `4.5333818e-05` 2021-03-09 19:44:50.049: INFO @log_profile : T train: 18.326495 2021-03-09 19:44:50.049: INFO @log_profile : T read data: 0.340644 2021-03-09 19:44:50.049: INFO @log_profile : T hooks: 3.012154 2021-03-09 19:44:50.049: INFO @main_loop : Epoch 377 done 2021-03-09 19:44:50.050: INFO @main_loop : Training epoch 378 2021-03-09 19:45:09.615: INFO @log_variables: train loss nanmean: 1.097635 2021-03-09 19:45:09.615: INFO @log_variables: train age_loss mean: 8.405499 2021-03-09 19:45:09.615: INFO @log_variables: train gender_loss mean: 0.228841 2021-03-09 19:45:09.615: INFO @log_variables: train age_mae mean: 7.861331 2021-03-09 19:45:09.615: INFO @log_variables: train gender_accuracy mean: 0.903139 2021-03-09 19:45:09.616: INFO @log_variables: train gender_confidence/loss nanmean: 0.064847 2021-03-09 19:45:09.616: INFO @log_variables: train gender_confidence/accuracy mean: 0.808521 2021-03-09 19:45:09.616: INFO @log_variables: train age_confidence/loss mean: 0.060615 2021-03-09 19:45:09.616: INFO @log_variables: train age_confidence/accuracy mean: 0.657841 2021-03-09 19:45:09.616: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:45:09.618: INFO @metrics_hook: train age_mae: 7.861 +-0.137 (13824) 2021-03-09 19:45:09.620: INFO @metrics_hook: train gender_accuracy: 0.903 +-0.005 (13824) 2021-03-09 19:45:11.792: INFO @decay_lr : LR updated to `4.510715e-05` 2021-03-09 19:45:11.793: INFO @log_profile : T train: 18.498069 2021-03-09 19:45:11.793: INFO @log_profile : T read data: 0.520853 2021-03-09 19:45:11.793: INFO @log_profile : T hooks: 2.670258 2021-03-09 19:45:11.793: INFO @main_loop : Epoch 378 done 2021-03-09 19:45:11.793: INFO @main_loop : Training epoch 379 2021-03-09 19:45:31.147: INFO @log_variables: train loss nanmean: 1.115308 2021-03-09 19:45:31.147: INFO @log_variables: train age_loss mean: 8.375120 2021-03-09 19:45:31.147: INFO @log_variables: train gender_loss mean: 0.249930 2021-03-09 19:45:31.147: INFO @log_variables: train age_mae mean: 7.832771 2021-03-09 19:45:31.148: INFO @log_variables: train gender_accuracy mean: 0.896340 2021-03-09 19:45:31.148: INFO @log_variables: train gender_confidence/loss nanmean: 0.067284 2021-03-09 19:45:31.148: INFO @log_variables: train gender_confidence/accuracy mean: 0.800926 2021-03-09 19:45:31.148: INFO @log_variables: train age_confidence/loss mean: 0.059440 2021-03-09 19:45:31.148: INFO @log_variables: train age_confidence/accuracy mean: 0.669416 2021-03-09 19:45:31.148: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:45:31.151: INFO @metrics_hook: train age_mae: 7.833 +-0.137 (13824) 2021-03-09 19:45:31.153: INFO @metrics_hook: train gender_accuracy: 0.896 +-0.005 (13824) 2021-03-09 19:45:33.547: INFO @decay_lr : LR updated to `4.4881614e-05` 2021-03-09 19:45:33.549: INFO @log_profile : T train: 18.471892 2021-03-09 19:45:33.549: INFO @log_profile : T read data: 0.354468 2021-03-09 19:45:33.549: INFO @log_profile : T hooks: 2.875492 2021-03-09 19:45:33.549: INFO @main_loop : Epoch 379 done 2021-03-09 19:45:33.549: INFO @main_loop : Training epoch 380 2021-03-09 19:45:53.115: INFO @log_variables: train loss nanmean: 1.106796 2021-03-09 19:45:53.116: INFO @log_variables: train age_loss mean: 8.395213 2021-03-09 19:45:53.116: INFO @log_variables: train gender_loss mean: 0.237655 2021-03-09 19:45:53.116: INFO @log_variables: train age_mae mean: 7.851217 2021-03-09 19:45:53.116: INFO @log_variables: train gender_accuracy mean: 0.901042 2021-03-09 19:45:53.116: INFO @log_variables: train gender_confidence/loss nanmean: 0.067476 2021-03-09 19:45:53.116: INFO @log_variables: train gender_confidence/accuracy mean: 0.789352 2021-03-09 19:45:53.116: INFO @log_variables: train age_confidence/loss mean: 0.060069 2021-03-09 19:45:53.116: INFO @log_variables: train age_confidence/accuracy mean: 0.663773 2021-03-09 19:45:53.116: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:45:53.118: INFO @metrics_hook: train age_mae: 7.851 +-0.138 (13824) 2021-03-09 19:45:53.119: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:45:55.589: INFO @decay_lr : LR updated to `4.4657205e-05` 2021-03-09 19:45:55.592: INFO @log_profile : T train: 18.654457 2021-03-09 19:45:55.592: INFO @log_profile : T read data: 0.373740 2021-03-09 19:45:55.592: INFO @log_profile : T hooks: 2.961135 2021-03-09 19:45:55.592: INFO @main_loop : Epoch 380 done 2021-03-09 19:45:55.592: INFO @main_loop : Training epoch 381 2021-03-09 19:46:14.792: INFO @log_variables: train loss nanmean: 1.112862 2021-03-09 19:46:14.793: INFO @log_variables: train age_loss mean: 8.450438 2021-03-09 19:46:14.793: INFO @log_variables: train gender_loss mean: 0.240147 2021-03-09 19:46:14.793: INFO @log_variables: train age_mae mean: 7.906919 2021-03-09 19:46:14.793: INFO @log_variables: train gender_accuracy mean: 0.900528 2021-03-09 19:46:14.793: INFO @log_variables: train gender_confidence/loss nanmean: 0.066629 2021-03-09 19:46:14.793: INFO @log_variables: train gender_confidence/accuracy mean: 0.798669 2021-03-09 19:46:14.793: INFO @log_variables: train age_confidence/loss mean: 0.059697 2021-03-09 19:46:14.793: INFO @log_variables: train age_confidence/accuracy mean: 0.667366 2021-03-09 19:46:14.793: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:46:14.795: INFO @metrics_hook: train age_mae: 7.907 +-0.140 (13823) 2021-03-09 19:46:14.796: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13823) 2021-03-09 19:46:16.895: INFO @decay_lr : LR updated to `4.443392e-05` 2021-03-09 19:46:16.897: INFO @log_profile : T train: 18.216351 2021-03-09 19:46:16.897: INFO @log_profile : T read data: 0.448839 2021-03-09 19:46:16.897: INFO @log_profile : T hooks: 2.589849 2021-03-09 19:46:16.897: INFO @main_loop : Epoch 381 done 2021-03-09 19:46:16.897: INFO @main_loop : Training epoch 382 2021-03-09 19:46:35.777: INFO @log_variables: train loss nanmean: 1.105718 2021-03-09 19:46:35.778: INFO @log_variables: train age_loss mean: 8.409511 2021-03-09 19:46:35.778: INFO @log_variables: train gender_loss mean: 0.234880 2021-03-09 19:46:35.778: INFO @log_variables: train age_mae mean: 7.865341 2021-03-09 19:46:35.778: INFO @log_variables: train gender_accuracy mean: 0.905671 2021-03-09 19:46:35.778: INFO @log_variables: train gender_confidence/loss nanmean: 0.067843 2021-03-09 19:46:35.778: INFO @log_variables: train gender_confidence/accuracy mean: 0.804398 2021-03-09 19:46:35.778: INFO @log_variables: train age_confidence/loss mean: 0.059846 2021-03-09 19:46:35.778: INFO @log_variables: train age_confidence/accuracy mean: 0.662182 2021-03-09 19:46:35.778: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:46:35.780: INFO @metrics_hook: train age_mae: 7.865 +-0.139 (13824) 2021-03-09 19:46:35.782: INFO @metrics_hook: train gender_accuracy: 0.906 +-0.005 (13824) 2021-03-09 19:46:37.813: INFO @decay_lr : LR updated to `4.421175e-05` 2021-03-09 19:46:37.814: INFO @log_profile : T train: 18.006621 2021-03-09 19:46:37.814: INFO @log_profile : T read data: 0.320896 2021-03-09 19:46:37.814: INFO @log_profile : T hooks: 2.539599 2021-03-09 19:46:37.814: INFO @main_loop : Epoch 382 done 2021-03-09 19:46:37.814: INFO @main_loop : Training epoch 383 2021-03-09 19:46:56.801: INFO @log_variables: train loss nanmean: 1.102269 2021-03-09 19:46:56.801: INFO @log_variables: train age_loss mean: 8.338271 2021-03-09 19:46:56.801: INFO @log_variables: train gender_loss mean: 0.238731 2021-03-09 19:46:56.802: INFO @log_variables: train age_mae mean: 7.795663 2021-03-09 19:46:56.802: INFO @log_variables: train gender_accuracy mean: 0.901548 2021-03-09 19:46:56.802: INFO @log_variables: train gender_confidence/loss nanmean: 0.067116 2021-03-09 19:46:56.802: INFO @log_variables: train gender_confidence/accuracy mean: 0.798105 2021-03-09 19:46:56.802: INFO @log_variables: train age_confidence/loss mean: 0.060099 2021-03-09 19:46:56.802: INFO @log_variables: train age_confidence/accuracy mean: 0.662109 2021-03-09 19:46:56.802: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:46:56.803: INFO @metrics_hook: train age_mae: 7.796 +-0.137 (13824) 2021-03-09 19:46:56.805: INFO @metrics_hook: train gender_accuracy: 0.902 +-0.005 (13824) 2021-03-09 19:46:58.781: INFO @decay_lr : LR updated to `4.399069e-05` 2021-03-09 19:46:58.782: INFO @log_profile : T train: 18.127814 2021-03-09 19:46:58.782: INFO @log_profile : T read data: 0.311795 2021-03-09 19:46:58.782: INFO @log_profile : T hooks: 2.478952 2021-03-09 19:46:58.782: INFO @main_loop : Epoch 383 done 2021-03-09 19:46:58.782: INFO @main_loop : Training epoch 384 2021-03-09 19:47:17.902: INFO @log_variables: train loss nanmean: 1.107853 2021-03-09 19:47:17.902: INFO @log_variables: train age_loss mean: 8.404504 2021-03-09 19:47:17.903: INFO @log_variables: train gender_loss mean: 0.239240 2021-03-09 19:47:17.903: INFO @log_variables: train age_mae mean: 7.860815 2021-03-09 19:47:17.903: INFO @log_variables: train gender_accuracy mean: 0.900752 2021-03-09 19:47:17.903: INFO @log_variables: train gender_confidence/loss nanmean: 0.066318 2021-03-09 19:47:17.903: INFO @log_variables: train gender_confidence/accuracy mean: 0.799262 2021-03-09 19:47:17.903: INFO @log_variables: train age_confidence/loss mean: 0.059998 2021-03-09 19:47:17.903: INFO @log_variables: train age_confidence/accuracy mean: 0.662326 2021-03-09 19:47:17.903: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:47:17.905: INFO @metrics_hook: train age_mae: 7.861 +-0.137 (13824) 2021-03-09 19:47:17.907: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:47:19.957: INFO @decay_lr : LR updated to `4.377074e-05` 2021-03-09 19:47:19.958: INFO @log_profile : T train: 18.108294 2021-03-09 19:47:19.958: INFO @log_profile : T read data: 0.447882 2021-03-09 19:47:19.958: INFO @log_profile : T hooks: 2.570341 2021-03-09 19:47:19.959: INFO @main_loop : Epoch 384 done 2021-03-09 19:47:19.959: INFO @main_loop : Training epoch 385 2021-03-09 19:47:39.549: INFO @log_variables: train loss nanmean: 1.114541 2021-03-09 19:47:39.551: INFO @log_variables: train age_loss mean: 8.460670 2021-03-09 19:47:39.551: INFO @log_variables: train gender_loss mean: 0.241480 2021-03-09 19:47:39.551: INFO @log_variables: train age_mae mean: 7.918127 2021-03-09 19:47:39.551: INFO @log_variables: train gender_accuracy mean: 0.900752 2021-03-09 19:47:39.551: INFO @log_variables: train gender_confidence/loss nanmean: 0.066455 2021-03-09 19:47:39.551: INFO @log_variables: train gender_confidence/accuracy mean: 0.797960 2021-03-09 19:47:39.551: INFO @log_variables: train age_confidence/loss mean: 0.059407 2021-03-09 19:47:39.551: INFO @log_variables: train age_confidence/accuracy mean: 0.669705 2021-03-09 19:47:39.551: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:47:39.553: INFO @metrics_hook: train age_mae: 7.918 +-0.140 (13824) 2021-03-09 19:47:39.554: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:47:42.368: INFO @decay_lr : LR updated to `4.3551885e-05` 2021-03-09 19:47:42.370: INFO @log_profile : T train: 18.664467 2021-03-09 19:47:42.370: INFO @log_profile : T read data: 0.387490 2021-03-09 19:47:42.370: INFO @log_profile : T hooks: 3.307608 2021-03-09 19:47:42.371: INFO @main_loop : Epoch 385 done 2021-03-09 19:47:42.371: INFO @main_loop : Training epoch 386 2021-03-09 19:48:03.394: INFO @log_variables: train loss nanmean: 1.104760 2021-03-09 19:48:03.394: INFO @log_variables: train age_loss mean: 8.366668 2021-03-09 19:48:03.394: INFO @log_variables: train gender_loss mean: 0.239531 2021-03-09 19:48:03.394: INFO @log_variables: train age_mae mean: 7.822244 2021-03-09 19:48:03.394: INFO @log_variables: train gender_accuracy mean: 0.901259 2021-03-09 19:48:03.394: INFO @log_variables: train gender_confidence/loss nanmean: 0.066155 2021-03-09 19:48:03.394: INFO @log_variables: train gender_confidence/accuracy mean: 0.798177 2021-03-09 19:48:03.394: INFO @log_variables: train age_confidence/loss mean: 0.060245 2021-03-09 19:48:03.394: INFO @log_variables: train age_confidence/accuracy mean: 0.664424 2021-03-09 19:48:03.394: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:48:03.396: INFO @metrics_hook: train age_mae: 7.822 +-0.135 (13824) 2021-03-09 19:48:03.398: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:48:06.049: INFO @decay_lr : LR updated to `4.3334127e-05` 2021-03-09 19:48:06.051: INFO @log_profile : T train: 20.006327 2021-03-09 19:48:06.051: INFO @log_profile : T read data: 0.464237 2021-03-09 19:48:06.051: INFO @log_profile : T hooks: 3.152120 2021-03-09 19:48:06.051: INFO @main_loop : Epoch 386 done 2021-03-09 19:48:06.051: INFO @main_loop : Training epoch 387 2021-03-09 19:48:27.311: INFO @log_variables: train loss nanmean: 1.099188 2021-03-09 19:48:27.311: INFO @log_variables: train age_loss mean: 8.316837 2021-03-09 19:48:27.311: INFO @log_variables: train gender_loss mean: 0.237198 2021-03-09 19:48:27.311: INFO @log_variables: train age_mae mean: 7.776828 2021-03-09 19:48:27.311: INFO @log_variables: train gender_accuracy mean: 0.901693 2021-03-09 19:48:27.311: INFO @log_variables: train gender_confidence/loss nanmean: 0.066766 2021-03-09 19:48:27.311: INFO @log_variables: train gender_confidence/accuracy mean: 0.803385 2021-03-09 19:48:27.311: INFO @log_variables: train age_confidence/loss mean: 0.060711 2021-03-09 19:48:27.311: INFO @log_variables: train age_confidence/accuracy mean: 0.658203 2021-03-09 19:48:27.311: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:48:27.312: INFO @metrics_hook: train age_mae: 7.777 +-0.136 (13824) 2021-03-09 19:48:27.314: INFO @metrics_hook: train gender_accuracy: 0.902 +-0.005 (13824) 2021-03-09 19:48:30.113: INFO @decay_lr : LR updated to `4.3117456e-05` 2021-03-09 19:48:30.115: INFO @log_profile : T train: 20.126769 2021-03-09 19:48:30.115: INFO @log_profile : T read data: 0.510596 2021-03-09 19:48:30.115: INFO @log_profile : T hooks: 3.365303 2021-03-09 19:48:30.115: INFO @main_loop : Epoch 387 done 2021-03-09 19:48:30.115: INFO @main_loop : Training epoch 388 2021-03-09 19:48:51.728: INFO @log_variables: train loss nanmean: 1.087730 2021-03-09 19:48:51.728: INFO @log_variables: train age_loss mean: 8.268644 2021-03-09 19:48:51.728: INFO @log_variables: train gender_loss mean: 0.229896 2021-03-09 19:48:51.728: INFO @log_variables: train age_mae mean: 7.729933 2021-03-09 19:48:51.729: INFO @log_variables: train gender_accuracy mean: 0.908637 2021-03-09 19:48:51.729: INFO @log_variables: train gender_confidence/loss nanmean: 0.066456 2021-03-09 19:48:51.729: INFO @log_variables: train gender_confidence/accuracy mean: 0.805700 2021-03-09 19:48:51.729: INFO @log_variables: train age_confidence/loss mean: 0.060583 2021-03-09 19:48:51.729: INFO @log_variables: train age_confidence/accuracy mean: 0.657986 2021-03-09 19:48:51.729: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:48:51.731: INFO @metrics_hook: train age_mae: 7.730 +-0.136 (13824) 2021-03-09 19:48:51.732: INFO @metrics_hook: train gender_accuracy: 0.909 +-0.005 (13824) 2021-03-09 19:48:54.358: INFO @decay_lr : LR updated to `4.290187e-05` 2021-03-09 19:48:54.360: INFO @log_profile : T train: 20.358138 2021-03-09 19:48:54.360: INFO @log_profile : T read data: 0.665503 2021-03-09 19:48:54.360: INFO @log_profile : T hooks: 3.161328 2021-03-09 19:48:54.360: INFO @main_loop : Epoch 388 done 2021-03-09 19:48:54.360: INFO @main_loop : Training epoch 389 2021-03-09 19:49:14.175: INFO @log_variables: train loss nanmean: 1.099333 2021-03-09 19:49:14.176: INFO @log_variables: train age_loss mean: 8.395805 2021-03-09 19:49:14.176: INFO @log_variables: train gender_loss mean: 0.230235 2021-03-09 19:49:14.176: INFO @log_variables: train age_mae mean: 7.849410 2021-03-09 19:49:14.176: INFO @log_variables: train gender_accuracy mean: 0.901476 2021-03-09 19:49:14.176: INFO @log_variables: train gender_confidence/loss nanmean: 0.065380 2021-03-09 19:49:14.176: INFO @log_variables: train gender_confidence/accuracy mean: 0.803241 2021-03-09 19:49:14.176: INFO @log_variables: train age_confidence/loss mean: 0.061394 2021-03-09 19:49:14.176: INFO @log_variables: train age_confidence/accuracy mean: 0.648727 2021-03-09 19:49:14.176: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:49:14.179: INFO @metrics_hook: train age_mae: 7.849 +-0.138 (13824) 2021-03-09 19:49:14.181: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:49:16.454: INFO @decay_lr : LR updated to `4.268736e-05` 2021-03-09 19:49:16.456: INFO @log_profile : T train: 18.835668 2021-03-09 19:49:16.456: INFO @log_profile : T read data: 0.375887 2021-03-09 19:49:16.456: INFO @log_profile : T hooks: 2.828801 2021-03-09 19:49:16.456: INFO @main_loop : Epoch 389 done 2021-03-09 19:49:16.456: INFO @main_loop : Training epoch 390 2021-03-09 19:49:36.899: INFO @log_variables: train loss nanmean: 1.102992 2021-03-09 19:49:36.899: INFO @log_variables: train age_loss mean: 8.348271 2021-03-09 19:49:36.899: INFO @log_variables: train gender_loss mean: 0.237785 2021-03-09 19:49:36.899: INFO @log_variables: train age_mae mean: 7.805592 2021-03-09 19:49:36.899: INFO @log_variables: train gender_accuracy mean: 0.903212 2021-03-09 19:49:36.899: INFO @log_variables: train gender_confidence/loss nanmean: 0.067887 2021-03-09 19:49:36.899: INFO @log_variables: train gender_confidence/accuracy mean: 0.795501 2021-03-09 19:49:36.899: INFO @log_variables: train age_confidence/loss mean: 0.060003 2021-03-09 19:49:36.899: INFO @log_variables: train age_confidence/accuracy mean: 0.665365 2021-03-09 19:49:36.900: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:49:36.903: INFO @metrics_hook: train age_mae: 7.806 +-0.138 (13824) 2021-03-09 19:49:36.906: INFO @metrics_hook: train gender_accuracy: 0.903 +-0.005 (13824) 2021-03-09 19:49:40.055: INFO @decay_lr : LR updated to `4.2473923e-05` 2021-03-09 19:49:40.061: INFO @log_profile : T train: 19.455708 2021-03-09 19:49:40.061: INFO @log_profile : T read data: 0.427580 2021-03-09 19:49:40.061: INFO @log_profile : T hooks: 3.664744 2021-03-09 19:49:40.061: INFO @main_loop : Epoch 390 done 2021-03-09 19:49:40.062: INFO @main_loop : Training epoch 391 2021-03-09 19:50:01.923: INFO @log_variables: train loss nanmean: 1.085952 2021-03-09 19:50:01.925: INFO @log_variables: train age_loss mean: 8.311901 2021-03-09 19:50:01.925: INFO @log_variables: train gender_loss mean: 0.226803 2021-03-09 19:50:01.925: INFO @log_variables: train age_mae mean: 7.773398 2021-03-09 19:50:01.925: INFO @log_variables: train gender_accuracy mean: 0.904080 2021-03-09 19:50:01.925: INFO @log_variables: train gender_confidence/loss nanmean: 0.064313 2021-03-09 19:50:01.925: INFO @log_variables: train gender_confidence/accuracy mean: 0.806641 2021-03-09 19:50:01.925: INFO @log_variables: train age_confidence/loss mean: 0.059827 2021-03-09 19:50:01.925: INFO @log_variables: train age_confidence/accuracy mean: 0.663918 2021-03-09 19:50:01.925: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:50:01.928: INFO @metrics_hook: train age_mae: 7.773 +-0.137 (13824) 2021-03-09 19:50:01.930: INFO @metrics_hook: train gender_accuracy: 0.904 +-0.005 (13824) 2021-03-09 19:50:04.829: INFO @decay_lr : LR updated to `4.2261552e-05` 2021-03-09 19:50:04.830: INFO @log_profile : T train: 20.467242 2021-03-09 19:50:04.831: INFO @log_profile : T read data: 0.766978 2021-03-09 19:50:04.831: INFO @log_profile : T hooks: 3.447824 2021-03-09 19:50:04.831: INFO @main_loop : Epoch 391 done 2021-03-09 19:50:04.831: INFO @main_loop : Training epoch 392 2021-03-09 19:50:26.057: INFO @log_variables: train loss nanmean: 1.116030 2021-03-09 19:50:26.057: INFO @log_variables: train age_loss mean: 8.438478 2021-03-09 19:50:26.057: INFO @log_variables: train gender_loss mean: 0.243291 2021-03-09 19:50:26.057: INFO @log_variables: train age_mae mean: 7.894878 2021-03-09 19:50:26.057: INFO @log_variables: train gender_accuracy mean: 0.900535 2021-03-09 19:50:26.057: INFO @log_variables: train gender_confidence/loss nanmean: 0.068095 2021-03-09 19:50:26.057: INFO @log_variables: train gender_confidence/accuracy mean: 0.798683 2021-03-09 19:50:26.057: INFO @log_variables: train age_confidence/loss mean: 0.059626 2021-03-09 19:50:26.058: INFO @log_variables: train age_confidence/accuracy mean: 0.663411 2021-03-09 19:50:26.058: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:50:26.060: INFO @metrics_hook: train age_mae: 7.895 +-0.138 (13824) 2021-03-09 19:50:26.062: INFO @metrics_hook: train gender_accuracy: 0.901 +-0.005 (13824) 2021-03-09 19:50:28.802: INFO @decay_lr : LR updated to `4.2050244e-05` 2021-03-09 19:50:28.805: INFO @log_profile : T train: 20.178053 2021-03-09 19:50:28.806: INFO @log_profile : T read data: 0.468702 2021-03-09 19:50:28.806: INFO @log_profile : T hooks: 3.268727 2021-03-09 19:50:28.806: INFO @main_loop : Epoch 392 done 2021-03-09 19:50:28.806: INFO @main_loop : Training epoch 393 2021-03-09 19:50:49.952: INFO @log_variables: train loss nanmean: 1.103554 2021-03-09 19:50:49.955: INFO @log_variables: train age_loss mean: 8.371248 2021-03-09 19:50:49.955: INFO @log_variables: train gender_loss mean: 0.236965 2021-03-09 19:50:49.955: INFO @log_variables: train age_mae mean: 7.831439 2021-03-09 19:50:49.955: INFO @log_variables: train gender_accuracy mean: 0.901837 2021-03-09 19:50:49.955: INFO @log_variables: train gender_confidence/loss nanmean: 0.067287 2021-03-09 19:50:49.955: INFO @log_variables: train gender_confidence/accuracy mean: 0.799407 2021-03-09 19:50:49.955: INFO @log_variables: train age_confidence/loss mean: 0.059822 2021-03-09 19:50:49.955: INFO @log_variables: train age_confidence/accuracy mean: 0.661820 2021-03-09 19:50:49.956: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:50:49.957: INFO @metrics_hook: train age_mae: 7.831 +-0.138 (13824) 2021-03-09 19:50:49.960: INFO @metrics_hook: train gender_accuracy: 0.902 +-0.005 (13824) 2021-03-09 19:50:52.904: INFO @decay_lr : LR updated to `4.1839994e-05` 2021-03-09 19:50:52.908: INFO @log_profile : T train: 20.091895 2021-03-09 19:50:52.908: INFO @log_profile : T read data: 0.474187 2021-03-09 19:50:52.908: INFO @log_profile : T hooks: 3.479376 2021-03-09 19:50:52.908: INFO @main_loop : Epoch 393 done 2021-03-09 19:50:52.909: INFO @main_loop : Training epoch 394 2021-03-09 19:51:16.043: INFO @log_variables: train loss nanmean: 1.106919 2021-03-09 19:51:16.045: INFO @log_variables: train age_loss mean: 8.414318 2021-03-09 19:51:16.046: INFO @log_variables: train gender_loss mean: 0.237384 2021-03-09 19:51:16.049: INFO @log_variables: train age_mae mean: 7.871389 2021-03-09 19:51:16.051: INFO @log_variables: train gender_accuracy mean: 0.902271 2021-03-09 19:51:16.052: INFO @log_variables: train gender_confidence/loss nanmean: 0.066274 2021-03-09 19:51:16.054: INFO @log_variables: train gender_confidence/accuracy mean: 0.799696 2021-03-09 19:51:16.055: INFO @log_variables: train age_confidence/loss mean: 0.059904 2021-03-09 19:51:16.055: INFO @log_variables: train age_confidence/accuracy mean: 0.668041 2021-03-09 19:51:16.055: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:51:16.057: INFO @metrics_hook: train age_mae: 7.871 +-0.140 (13824) 2021-03-09 19:51:16.059: INFO @metrics_hook: train gender_accuracy: 0.902 +-0.005 (13824) 2021-03-09 19:51:19.328: INFO @decay_lr : LR updated to `4.1630796e-05` 2021-03-09 19:51:19.331: INFO @log_profile : T train: 21.851550 2021-03-09 19:51:19.331: INFO @log_profile : T read data: 0.747274 2021-03-09 19:51:19.331: INFO @log_profile : T hooks: 3.766580 2021-03-09 19:51:19.331: INFO @main_loop : Epoch 394 done 2021-03-09 19:51:19.331: INFO @main_loop : Training epoch 395 2021-03-09 19:51:42.063: INFO @log_variables: train loss nanmean: 1.105098 2021-03-09 19:51:42.063: INFO @log_variables: train age_loss mean: 8.400647 2021-03-09 19:51:42.063: INFO @log_variables: train gender_loss mean: 0.235598 2021-03-09 19:51:42.063: INFO @log_variables: train age_mae mean: 7.857230 2021-03-09 19:51:42.064: INFO @log_variables: train gender_accuracy mean: 0.904948 2021-03-09 19:51:42.064: INFO @log_variables: train gender_confidence/loss nanmean: 0.067314 2021-03-09 19:51:42.064: INFO @log_variables: train gender_confidence/accuracy mean: 0.793041 2021-03-09 19:51:42.064: INFO @log_variables: train age_confidence/loss mean: 0.059908 2021-03-09 19:51:42.064: INFO @log_variables: train age_confidence/accuracy mean: 0.670645 2021-03-09 19:51:42.064: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:51:42.066: INFO @metrics_hook: train age_mae: 7.857 +-0.140 (13824) 2021-03-09 19:51:42.068: INFO @metrics_hook: train gender_accuracy: 0.905 +-0.005 (13824) 2021-03-09 19:51:45.572: INFO @decay_lr : LR updated to `4.142264e-05` 2021-03-09 19:51:45.574: INFO @log_profile : T train: 21.723069 2021-03-09 19:51:45.574: INFO @log_profile : T read data: 0.440101 2021-03-09 19:51:45.574: INFO @log_profile : T hooks: 4.022633 2021-03-09 19:51:45.574: INFO @main_loop : Epoch 395 done 2021-03-09 19:51:45.574: INFO @main_loop : Training epoch 396 2021-03-09 19:52:08.843: INFO @log_variables: train loss nanmean: 1.090010 2021-03-09 19:52:08.846: INFO @log_variables: train age_loss mean: 8.246801 2021-03-09 19:52:08.846: INFO @log_variables: train gender_loss mean: 0.233255 2021-03-09 19:52:08.846: INFO @log_variables: train age_mae mean: 7.707456 2021-03-09 19:52:08.847: INFO @log_variables: train gender_accuracy mean: 0.904586 2021-03-09 19:52:08.847: INFO @log_variables: train gender_confidence/loss nanmean: 0.067867 2021-03-09 19:52:08.847: INFO @log_variables: train gender_confidence/accuracy mean: 0.795573 2021-03-09 19:52:08.847: INFO @log_variables: train age_confidence/loss mean: 0.060384 2021-03-09 19:52:08.847: INFO @log_variables: train age_confidence/accuracy mean: 0.661097 2021-03-09 19:52:08.847: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:52:08.849: INFO @metrics_hook: train age_mae: 7.707 +-0.136 (13824) 2021-03-09 19:52:08.851: INFO @metrics_hook: train gender_accuracy: 0.905 +-0.005 (13824) 2021-03-09 19:52:11.801: INFO @decay_lr : LR updated to `4.1215528e-05` 2021-03-09 19:52:11.805: INFO @log_profile : T train: 22.263329 2021-03-09 19:52:11.805: INFO @log_profile : T read data: 0.440395 2021-03-09 19:52:11.805: INFO @log_profile : T hooks: 3.466449 2021-03-09 19:52:11.806: INFO @main_loop : Epoch 396 done 2021-03-09 19:52:11.806: INFO @main_loop : Training epoch 397 2021-03-09 19:52:33.022: INFO @log_variables: train loss nanmean: 1.092199 2021-03-09 19:52:33.022: INFO @log_variables: train age_loss mean: 8.309677 2021-03-09 19:52:33.022: INFO @log_variables: train gender_loss mean: 0.230215 2021-03-09 19:52:33.022: INFO @log_variables: train age_mae mean: 7.770764 2021-03-09 19:52:33.022: INFO @log_variables: train gender_accuracy mean: 0.907762 2021-03-09 19:52:33.022: INFO @log_variables: train gender_confidence/loss nanmean: 0.066731 2021-03-09 19:52:33.022: INFO @log_variables: train gender_confidence/accuracy mean: 0.802503 2021-03-09 19:52:33.023: INFO @log_variables: train age_confidence/loss mean: 0.060756 2021-03-09 19:52:33.023: INFO @log_variables: train age_confidence/accuracy mean: 0.653259 2021-03-09 19:52:33.023: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:52:33.025: INFO @metrics_hook: train age_mae: 7.771 +-0.139 (13823) 2021-03-09 19:52:33.027: INFO @metrics_hook: train gender_accuracy: 0.908 +-0.005 (13823) 2021-03-09 19:52:35.955: INFO @decay_lr : LR updated to `4.100945e-05` 2021-03-09 19:52:35.957: INFO @log_profile : T train: 19.964876 2021-03-09 19:52:35.957: INFO @log_profile : T read data: 0.624610 2021-03-09 19:52:35.957: INFO @log_profile : T hooks: 3.498655 2021-03-09 19:52:35.957: INFO @main_loop : Epoch 397 done 2021-03-09 19:52:35.957: INFO @main_loop : Training epoch 398 2021-03-09 19:52:56.572: INFO @log_variables: train loss nanmean: 1.094688 2021-03-09 19:52:56.572: INFO @log_variables: train age_loss mean: 8.359437 2021-03-09 19:52:56.572: INFO @log_variables: train gender_loss mean: 0.228801 2021-03-09 19:52:56.572: INFO @log_variables: train age_mae mean: 7.814818 2021-03-09 19:52:56.572: INFO @log_variables: train gender_accuracy mean: 0.906178 2021-03-09 19:52:56.573: INFO @log_variables: train gender_confidence/loss nanmean: 0.066272 2021-03-09 19:52:56.573: INFO @log_variables: train gender_confidence/accuracy mean: 0.800275 2021-03-09 19:52:56.573: INFO @log_variables: train age_confidence/loss mean: 0.060466 2021-03-09 19:52:56.573: INFO @log_variables: train age_confidence/accuracy mean: 0.660373 2021-03-09 19:52:56.573: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:52:56.575: INFO @metrics_hook: train age_mae: 7.815 +-0.138 (13824) 2021-03-09 19:52:56.577: INFO @metrics_hook: train gender_accuracy: 0.906 +-0.005 (13824) 2021-03-09 19:52:59.185: INFO @decay_lr : LR updated to `4.0804403e-05` 2021-03-09 19:52:59.187: INFO @log_profile : T train: 19.594224 2021-03-09 19:52:59.187: INFO @log_profile : T read data: 0.393428 2021-03-09 19:52:59.187: INFO @log_profile : T hooks: 3.182271 2021-03-09 19:52:59.187: INFO @main_loop : Epoch 398 done 2021-03-09 19:52:59.187: INFO @main_loop : Training epoch 399 2021-03-09 19:53:19.256: INFO @log_variables: train loss nanmean: 1.099617 2021-03-09 19:53:19.256: INFO @log_variables: train age_loss mean: 8.359992 2021-03-09 19:53:19.256: INFO @log_variables: train gender_loss mean: 0.234169 2021-03-09 19:53:19.256: INFO @log_variables: train age_mae mean: 7.818363 2021-03-09 19:53:19.256: INFO @log_variables: train gender_accuracy mean: 0.903212 2021-03-09 19:53:19.256: INFO @log_variables: train gender_confidence/loss nanmean: 0.066064 2021-03-09 19:53:19.256: INFO @log_variables: train gender_confidence/accuracy mean: 0.802590 2021-03-09 19:53:19.256: INFO @log_variables: train age_confidence/loss mean: 0.060673 2021-03-09 19:53:19.256: INFO @log_variables: train age_confidence/accuracy mean: 0.658926 2021-03-09 19:53:19.256: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:53:19.258: INFO @metrics_hook: train age_mae: 7.818 +-0.139 (13824) 2021-03-09 19:53:19.259: INFO @metrics_hook: train gender_accuracy: 0.903 +-0.005 (13824) 2021-03-09 19:53:21.725: INFO @decay_lr : LR updated to `4.0600382e-05` 2021-03-09 19:53:21.727: INFO @log_profile : T train: 19.065416 2021-03-09 19:53:21.728: INFO @log_profile : T read data: 0.365705 2021-03-09 19:53:21.728: INFO @log_profile : T hooks: 3.052189 2021-03-09 19:53:21.728: INFO @main_loop : Epoch 399 done 2021-03-09 19:53:21.728: INFO @main_loop : Training epoch 400 2021-03-09 19:53:41.917: INFO @log_variables: train loss nanmean: 1.104192 2021-03-09 19:53:41.917: INFO @log_variables: train age_loss mean: 8.443221 2021-03-09 19:53:41.918: INFO @log_variables: train gender_loss mean: 0.232155 2021-03-09 19:53:41.918: INFO @log_variables: train age_mae mean: 7.899513 2021-03-09 19:53:41.918: INFO @log_variables: train gender_accuracy mean: 0.904007 2021-03-09 19:53:41.918: INFO @log_variables: train gender_confidence/loss nanmean: 0.065804 2021-03-09 19:53:41.918: INFO @log_variables: train gender_confidence/accuracy mean: 0.806930 2021-03-09 19:53:41.918: INFO @log_variables: train age_confidence/loss mean: 0.059772 2021-03-09 19:53:41.918: INFO @log_variables: train age_confidence/accuracy mean: 0.668620 2021-03-09 19:53:41.918: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG 2021-03-09 19:53:41.920: INFO @metrics_hook: train age_mae: 7.900 +-0.139 (13824) 2021-03-09 19:53:41.922: INFO @metrics_hook: train gender_accuracy: 0.904 +-0.005 (13824) 2021-03-09 19:53:44.595: INFO @decay_lr : LR updated to `4.039738e-05` 2021-03-09 19:53:44.981: INFO @save : Model saved to: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG/model_400.ckpt 2021-03-09 19:53:44.981: INFO @stop_after : EpochStopperHook triggered 2021-03-09 19:53:44.983: INFO @log_profile : T train: 19.039981 2021-03-09 19:53:44.983: INFO @log_profile : T read data: 0.499193 2021-03-09 19:53:44.983: INFO @log_profile : T hooks: 3.654238 2021-03-09 19:53:44.983: INFO @main_loop : Training terminated: Training terminated after epoch 400 2021-03-09 19:53:44.985: INFO @log_dir : Output dir: log-nightly/gender-age/2021-03-09-nightly-gender-age-939668da-gxyG