2019-11-14 11:22:21.190: INFO @api : Creating dataset 2019-11-14 11:22:23.496: WARNING @deprecation_wrapper: From /home/ala/emloop-tensorflow/emloop_tensorflow/utils/profiler.py:12: The name tf.Session is deprecated. Please use tf.compat.v1.Session instead. 2019-11-14 11:22:23.533: INFO @api : EmbeddingDatasetWrapper created 2019-11-14 11:22:23.533: INFO @api : Creating a model 2019-11-14 11:22:23.553: INFO @model : Creating TF model on 1 GPU devices 2019-11-14 11:22:23.553: WARNING @deprecation_wrapper: From /home/ala/emloop-tensorflow/emloop_tensorflow/model.py:415: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead. 2019-11-14 11:22:26.818: WARNING @deprecation_wrapper: From /home/ala/emloop-tensorflow/emloop_tensorflow/model.py:140: The name tf.variable_scope is deprecated. Please use tf.compat.v1.variable_scope instead. 2019-11-14 11:22:26.818: WARNING @deprecation_wrapper: From /home/ala/emloop-tensorflow/emloop_tensorflow/model.py:140: The name tf.get_variable_scope is deprecated. Please use tf.compat.v1.get_variable_scope instead. 2019-11-14 11:22:26.818: WARNING @deprecation_wrapper: From /home/ala/emloop-tensorflow/emloop_tensorflow/model.py:140: The name tf.AUTO_REUSE is deprecated. Please use tf.compat.v1.AUTO_REUSE instead. 2019-11-14 11:22:26.896: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:26.920: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.090: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.174: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.200: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.309: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.335: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.418: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.487: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.511: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.609: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.634: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.704: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.774: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.805: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.903: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:27.927: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:28.000: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:28.073: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:28.098: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:28.128: WARNING @deprecation : From /home/ala/faces/models/embedding_body.py:69: flatten (from tensorflow.python.layers.core) is deprecated and will be removed in a future version. Instructions for updating: Use keras.layers.flatten instead. 2019-11-14 11:22:28.141: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AttributeError: module 'gast' has no attribute 'Num' 2019-11-14 11:22:28.146: WARNING @deprecation : From /home/ala/faces/models/embedding_body.py:70: dropout (from tensorflow.python.layers.core) is deprecated and will be removed in a future version. Instructions for updating: Use keras.layers.dropout instead. 2019-11-14 11:22:28.159: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:28.172: WARNING @deprecation : From /home/ala/faces/models/embedding_body.py:71: dense (from tensorflow.python.layers.core) is deprecated and will be removed in a future version. Instructions for updating: Use keras.layers.dense instead. 2019-11-14 11:22:28.173: WARNING @deprecation : From /usr/lib/python3.7/site-packages/tensorflow/python/ops/init_ops.py:1251: calling VarianceScaling.__init__ (from tensorflow.python.ops.init_ops) with dtype is deprecated and will be removed in a future version. Instructions for updating: Call initializer instance with the dtype argument instead of passing it to the constructor 2019-11-14 11:22:28.262: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:28.278: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:28.385: WARNING @ag_logging : Entity > could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting >: AssertionError: Bad argument number for Name: 3, expecting 4 2019-11-14 11:22:28.428: WARNING @deprecation : From /usr/lib/python3.7/site-packages/tensorflow/contrib/losses/python/metric_learning/metric_loss_ops.py:220: add_dispatch_support..wrapper (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.where in 2.0, which has the same broadcast rule as np.where 2019-11-14 11:22:29.665: WARNING @deprecation_wrapper: From /home/ala/emloop-tensorflow/emloop_tensorflow/model.py:180: The name tf.train.Saver is deprecated. Please use tf.compat.v1.train.Saver instead. 2019-11-14 11:22:30.139: INFO @model : Number of parameters: 479624 2019-11-14 11:22:30.140: INFO @api : BodyEmbeddingModel created 2019-11-14 11:22:30.140: INFO @api : Creating hooks 2019-11-14 11:22:30.152: INFO @api : ComputeStats created 2019-11-14 11:22:30.152: INFO @api : LogVariables created 2019-11-14 11:22:30.153: INFO @api : LogProfile created 2019-11-14 11:22:30.154: INFO @api : LogDir created 2019-11-14 11:22:30.173: INFO @api : ComputeMatchingMetrics created 2019-11-14 11:22:30.173: WARNING @abstract_hook: Argument `streams` was not recognized by `WriteTensorBoard`. Recognized arguments are `['model', 'output_dir', 'image_variables', 'flush_secs', 'visualize_graph', 'on_unknown_type', 'on_missing_variable', 'kwargs']`. 2019-11-14 11:22:30.174: WARNING @deprecation_wrapper: From /home/ala/emloop-tensorflow/emloop_tensorflow/hooks/write_tensorboard.py:78: The name tf.summary.FileWriter is deprecated. Please use tf.compat.v1.summary.FileWriter instead. 2019-11-14 11:22:30.174: INFO @api : WriteTensorBoard created 2019-11-14 11:22:30.178: INFO @api : SaveEmbeddingPredictions created 2019-11-14 11:22:30.178: INFO @api : SaveEmbeddingPredictions created 2019-11-14 11:22:32.209: INFO @api : EvaluateEmbedding created 2019-11-14 11:22:32.210: INFO @api : DecayLR created 2019-11-14 11:22:32.211: INFO @api : SaveBest created 2019-11-14 11:22:32.212: INFO @api : StopAfter created 2019-11-14 11:22:32.212: INFO @api : ShowProgress created 2019-11-14 11:22:32.212: WARNING @api : TrainingTrace hook added between hooks. Add it to your config.yaml to suppress this warning. 2019-11-14 11:22:32.213: INFO @api : Creating main loop 2019-11-14 11:22:32.213: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 11:22:32.214: INFO @main_loop : Training epoch 1 2019-11-14 11:22:34.619: WARNING @main_loop : Some sources provided by the stream do not match model placeholders. Set `main_loop.on_unused_sources` to `ignore` in order to suppress this warning. Extra sources: ['filenames'] 2019-11-14 11:24:05.325: INFO @log_variables: train loss nanmean: 0.504290 2019-11-14 11:24:05.325: INFO @log_variables: train positive_distance nanmean: 0.641603 2019-11-14 11:24:05.325: INFO @log_variables: train negative_distance nanmean: 1.413214 2019-11-14 11:24:05.325: INFO @log_variables: valid loss nanmean: 0.469086 2019-11-14 11:24:05.325: INFO @log_variables: valid positive_distance nanmean: 0.600976 2019-11-14 11:24:05.325: INFO @log_variables: valid negative_distance nanmean: 1.370352 2019-11-14 11:24:05.326: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 11:25:43.228: INFO @metrics_hook: train matching accuracy: 0.8748349760376164, N=110590, DB_SIZE=110592, N_IDS=7318 2019-11-14 11:25:44.142: INFO @metrics_hook: valid matching accuracy: 0.9649141516476485, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 11:25:44.311: INFO @evaluate_embedding: best threshold 0.9856638610363007 2019-11-14 11:25:44.390: INFO @evaluate_embedding: positive_distances_above_threshold 256 2019-11-14 11:25:44.390: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 11:25:44.527: INFO @decay_lr : LR updated to `0.000995` 2019-11-14 11:25:44.527: WARNING @deprecation_wrapper: From /home/ala/emloop-tensorflow/emloop_tensorflow/model.py:301: The name tf.train.write_graph is deprecated. Please use tf.io.write_graph instead. 2019-11-14 11:25:44.812: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 11:25:44.830: INFO @log_profile : T train: 47.441568 2019-11-14 11:25:44.830: INFO @log_profile : T valid: 1.554520 2019-11-14 11:25:44.830: INFO @log_profile : T read data: 39.121851 2019-11-14 11:25:44.830: INFO @log_profile : T hooks: 104.429638 2019-11-14 11:25:44.830: INFO @main_loop : Epoch 1 done 2019-11-14 11:25:44.830: INFO @main_loop : Training epoch 2 2019-11-14 11:27:09.129: INFO @log_variables: train loss nanmean: 0.328002 2019-11-14 11:27:09.129: INFO @log_variables: train positive_distance nanmean: 0.637728 2019-11-14 11:27:09.130: INFO @log_variables: train negative_distance nanmean: 1.417295 2019-11-14 11:27:09.130: INFO @log_variables: valid loss nanmean: 0.416533 2019-11-14 11:27:09.130: INFO @log_variables: valid positive_distance nanmean: 0.610469 2019-11-14 11:27:09.130: INFO @log_variables: valid negative_distance nanmean: 1.379455 2019-11-14 11:27:09.130: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 11:28:59.004: INFO @metrics_hook: train matching accuracy: 0.9696542245370371, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-14 11:29:00.149: INFO @metrics_hook: valid matching accuracy: 0.9721659379332409, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 11:29:00.323: INFO @evaluate_embedding: best threshold 0.9949617087841035 2019-11-14 11:29:00.401: INFO @evaluate_embedding: positive_distances_above_threshold 256 2019-11-14 11:29:00.402: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 11:29:00.562: INFO @decay_lr : LR updated to `0.000990025` 2019-11-14 11:29:00.811: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 11:29:00.833: INFO @log_profile : T train: 43.724282 2019-11-14 11:29:00.833: INFO @log_profile : T valid: 1.297273 2019-11-14 11:29:00.833: INFO @log_profile : T read data: 34.010427 2019-11-14 11:29:00.833: INFO @log_profile : T hooks: 116.901563 2019-11-14 11:29:00.833: INFO @main_loop : Epoch 2 done 2019-11-14 11:29:00.833: INFO @main_loop : Training epoch 3 2019-11-14 11:30:51.203: INFO @log_variables: train loss nanmean: 0.277735 2019-11-14 11:30:51.203: INFO @log_variables: train positive_distance nanmean: 0.629031 2019-11-14 11:30:51.203: INFO @log_variables: train negative_distance nanmean: 1.417744 2019-11-14 11:30:51.204: INFO @log_variables: valid loss nanmean: 0.372898 2019-11-14 11:30:51.204: INFO @log_variables: valid positive_distance nanmean: 0.607442 2019-11-14 11:30:51.204: INFO @log_variables: valid negative_distance nanmean: 1.381189 2019-11-14 11:30:51.204: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 11:33:24.388: INFO @metrics_hook: train matching accuracy: 0.9800980179398148, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-14 11:33:25.898: INFO @metrics_hook: valid matching accuracy: 0.9758984749920017, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 11:33:26.081: INFO @evaluate_embedding: best threshold 0.9943155348300934 2019-11-14 11:33:26.167: INFO @evaluate_embedding: positive_distances_above_threshold 256 2019-11-14 11:33:26.167: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 11:33:26.356: INFO @decay_lr : LR updated to `0.0009850749` 2019-11-14 11:33:26.651: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 11:33:26.674: INFO @log_profile : T train: 44.602127 2019-11-14 11:33:26.674: INFO @log_profile : T valid: 1.402818 2019-11-14 11:33:26.674: INFO @log_profile : T read data: 56.013045 2019-11-14 11:33:26.674: INFO @log_profile : T hooks: 163.745162 2019-11-14 11:33:26.674: INFO @main_loop : Epoch 3 done 2019-11-14 11:33:26.674: INFO @main_loop : Training epoch 4 2019-11-14 11:35:28.809: INFO @log_variables: train loss nanmean: 0.248095 2019-11-14 11:35:28.809: INFO @log_variables: train positive_distance nanmean: 0.622856 2019-11-14 11:35:28.809: INFO @log_variables: train negative_distance nanmean: 1.417988 2019-11-14 11:35:28.809: INFO @log_variables: valid loss nanmean: 0.382974 2019-11-14 11:35:28.809: INFO @log_variables: valid positive_distance nanmean: 0.603346 2019-11-14 11:35:28.809: INFO @log_variables: valid negative_distance nanmean: 1.370026 2019-11-14 11:35:28.821: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 11:38:04.773: INFO @metrics_hook: train matching accuracy: 0.9848090277777778, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-14 11:38:06.434: INFO @metrics_hook: valid matching accuracy: 0.9761117628239309, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 11:38:06.602: INFO @evaluate_embedding: best threshold 0.9866863787174223 2019-11-14 11:38:06.673: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 11:38:06.673: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 11:38:06.816: INFO @decay_lr : LR updated to `0.0009801495` 2019-11-14 11:38:07.057: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 11:38:07.082: INFO @log_profile : T train: 47.602486 2019-11-14 11:38:07.082: INFO @log_profile : T valid: 1.821451 2019-11-14 11:38:07.083: INFO @log_profile : T read data: 62.881512 2019-11-14 11:38:07.083: INFO @log_profile : T hooks: 168.007716 2019-11-14 11:38:07.083: INFO @main_loop : Epoch 4 done 2019-11-14 11:38:07.083: INFO @main_loop : Training epoch 5 2019-11-14 11:40:03.083: INFO @log_variables: train loss nanmean: 0.226979 2019-11-14 11:40:03.083: INFO @log_variables: train positive_distance nanmean: 0.618343 2019-11-14 11:40:03.083: INFO @log_variables: train negative_distance nanmean: 1.418145 2019-11-14 11:40:03.083: INFO @log_variables: valid loss nanmean: 0.372166 2019-11-14 11:40:03.083: INFO @log_variables: valid positive_distance nanmean: 0.596937 2019-11-14 11:40:03.083: INFO @log_variables: valid negative_distance nanmean: 1.372149 2019-11-14 11:40:03.083: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 11:42:39.000: INFO @metrics_hook: train matching accuracy: 0.9871328848379629, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-14 11:42:40.626: INFO @metrics_hook: valid matching accuracy: 0.9788845046390103, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 11:42:40.851: INFO @evaluate_embedding: best threshold 0.9845430254936218 2019-11-14 11:42:40.979: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 11:42:40.980: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 11:42:41.320: INFO @decay_lr : LR updated to `0.00097524875` 2019-11-14 11:42:41.660: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 11:42:41.683: INFO @log_profile : T train: 46.551546 2019-11-14 11:42:41.683: INFO @log_profile : T valid: 1.361732 2019-11-14 11:42:41.683: INFO @log_profile : T read data: 62.321688 2019-11-14 11:42:41.683: INFO @log_profile : T hooks: 164.287032 2019-11-14 11:42:41.683: INFO @main_loop : Epoch 5 done 2019-11-14 11:42:41.683: INFO @main_loop : Training epoch 6 2019-11-14 11:44:42.253: INFO @log_variables: train loss nanmean: 0.213906 2019-11-14 11:44:42.253: INFO @log_variables: train positive_distance nanmean: 0.614411 2019-11-14 11:44:42.253: INFO @log_variables: train negative_distance nanmean: 1.418254 2019-11-14 11:44:42.253: INFO @log_variables: valid loss nanmean: 0.341378 2019-11-14 11:44:42.253: INFO @log_variables: valid positive_distance nanmean: 0.619865 2019-11-14 11:44:42.253: INFO @log_variables: valid negative_distance nanmean: 1.387899 2019-11-14 11:44:42.253: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 11:47:22.802: INFO @metrics_hook: train matching accuracy: 0.9885795408306282, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-14 11:47:24.136: INFO @metrics_hook: valid matching accuracy: 0.9820838221179482, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 11:47:24.348: INFO @evaluate_embedding: best threshold 1.0038820207118988 2019-11-14 11:47:24.441: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 11:47:24.442: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 11:47:24.675: INFO @decay_lr : LR updated to `0.0009703725` 2019-11-14 11:47:25.089: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 11:47:25.128: INFO @log_profile : T train: 47.930272 2019-11-14 11:47:25.128: INFO @log_profile : T valid: 1.498627 2019-11-14 11:47:25.128: INFO @log_profile : T read data: 64.750726 2019-11-14 11:47:25.128: INFO @log_profile : T hooks: 169.183701 2019-11-14 11:47:25.128: INFO @main_loop : Epoch 6 done 2019-11-14 11:47:25.128: INFO @main_loop : Training epoch 7 2019-11-14 11:49:23.024: INFO @log_variables: train loss nanmean: 0.201182 2019-11-14 11:49:23.024: INFO @log_variables: train positive_distance nanmean: 0.610177 2019-11-14 11:49:23.024: INFO @log_variables: train negative_distance nanmean: 1.418341 2019-11-14 11:49:23.024: INFO @log_variables: valid loss nanmean: 0.338558 2019-11-14 11:49:23.024: INFO @log_variables: valid positive_distance nanmean: 0.616608 2019-11-14 11:49:23.024: INFO @log_variables: valid negative_distance nanmean: 1.384869 2019-11-14 11:49:23.024: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 11:51:55.143: INFO @metrics_hook: train matching accuracy: 0.9892306857638888, N=110592, DB_SIZE=110592, N_IDS=7323 2019-11-14 11:51:56.341: INFO @metrics_hook: valid matching accuracy: 0.9797376559667271, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 11:51:56.565: INFO @evaluate_embedding: best threshold 1.0007386803627016 2019-11-14 11:51:56.660: INFO @evaluate_embedding: positive_distances_above_threshold 256 2019-11-14 11:51:56.660: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 11:51:57.012: INFO @decay_lr : LR updated to `0.0009655207` 2019-11-14 11:51:57.015: INFO @log_profile : T train: 46.819308 2019-11-14 11:51:57.015: INFO @log_profile : T valid: 1.422265 2019-11-14 11:51:57.015: INFO @log_profile : T read data: 62.873726 2019-11-14 11:51:57.015: INFO @log_profile : T hooks: 160.692222 2019-11-14 11:51:57.015: INFO @main_loop : Epoch 7 done 2019-11-14 11:51:57.015: INFO @main_loop : Training epoch 8 2019-11-14 11:54:03.779: INFO @log_variables: train loss nanmean: 0.191193 2019-11-14 11:54:03.779: INFO @log_variables: train positive_distance nanmean: 0.608643 2019-11-14 11:54:03.779: INFO @log_variables: train negative_distance nanmean: 1.418431 2019-11-14 11:54:03.779: INFO @log_variables: valid loss nanmean: 0.325272 2019-11-14 11:54:03.779: INFO @log_variables: valid positive_distance nanmean: 0.614979 2019-11-14 11:54:03.779: INFO @log_variables: valid negative_distance nanmean: 1.387568 2019-11-14 11:54:03.779: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 11:56:41.334: INFO @metrics_hook: train matching accuracy: 0.9899720592091581, N=110591, DB_SIZE=110592, N_IDS=7319 2019-11-14 11:56:42.545: INFO @metrics_hook: valid matching accuracy: 0.9817638903700544, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 11:56:43.152: INFO @evaluate_embedding: best threshold 1.0012734830379484 2019-11-14 11:56:43.280: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 11:56:43.280: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 11:56:43.553: INFO @decay_lr : LR updated to `0.00096069305` 2019-11-14 11:56:43.555: INFO @log_profile : T train: 47.578902 2019-11-14 11:56:43.555: INFO @log_profile : T valid: 1.465546 2019-11-14 11:56:43.555: INFO @log_profile : T read data: 70.995320 2019-11-14 11:56:43.555: INFO @log_profile : T hooks: 166.414614 2019-11-14 11:56:43.555: INFO @main_loop : Epoch 8 done 2019-11-14 11:56:43.556: INFO @main_loop : Training epoch 9 2019-11-14 11:58:47.769: INFO @log_variables: train loss nanmean: 0.184554 2019-11-14 11:58:47.770: INFO @log_variables: train positive_distance nanmean: 0.608841 2019-11-14 11:58:47.770: INFO @log_variables: train negative_distance nanmean: 1.418492 2019-11-14 11:58:47.770: INFO @log_variables: valid loss nanmean: 0.333916 2019-11-14 11:58:47.770: INFO @log_variables: valid positive_distance nanmean: 0.614909 2019-11-14 11:58:47.770: INFO @log_variables: valid negative_distance nanmean: 1.386306 2019-11-14 11:58:47.770: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:01:23.162: INFO @metrics_hook: train matching accuracy: 0.9905146846064815, N=110592, DB_SIZE=110592, N_IDS=7307 2019-11-14 12:01:24.776: INFO @metrics_hook: valid matching accuracy: 0.9817638903700544, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:01:25.089: INFO @evaluate_embedding: best threshold 1.000607818365097 2019-11-14 12:01:25.276: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:01:25.276: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:01:25.588: INFO @decay_lr : LR updated to `0.0009558896` 2019-11-14 12:01:25.590: INFO @log_profile : T train: 45.887056 2019-11-14 12:01:25.590: INFO @log_profile : T valid: 1.410693 2019-11-14 12:01:25.590: INFO @log_profile : T read data: 70.591342 2019-11-14 12:01:25.590: INFO @log_profile : T hooks: 164.067196 2019-11-14 12:01:25.590: INFO @main_loop : Epoch 9 done 2019-11-14 12:01:25.591: INFO @main_loop : Training epoch 10 2019-11-14 12:03:37.398: INFO @log_variables: train loss nanmean: 0.176076 2019-11-14 12:03:37.399: INFO @log_variables: train positive_distance nanmean: 0.605916 2019-11-14 12:03:37.399: INFO @log_variables: train negative_distance nanmean: 1.418544 2019-11-14 12:03:37.399: INFO @log_variables: valid loss nanmean: 0.324960 2019-11-14 12:03:37.399: INFO @log_variables: valid positive_distance nanmean: 0.619094 2019-11-14 12:03:37.399: INFO @log_variables: valid negative_distance nanmean: 1.389999 2019-11-14 12:03:37.399: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:06:15.576: INFO @metrics_hook: train matching accuracy: 0.9909667151938223, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-14 12:06:17.196: INFO @metrics_hook: valid matching accuracy: 0.981870534286019, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:06:17.396: INFO @evaluate_embedding: best threshold 1.004546672105789 2019-11-14 12:06:17.493: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:06:17.493: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:06:17.677: INFO @decay_lr : LR updated to `0.00095111015` 2019-11-14 12:06:17.679: INFO @log_profile : T train: 46.834224 2019-11-14 12:06:17.679: INFO @log_profile : T valid: 1.442052 2019-11-14 12:06:17.679: INFO @log_profile : T read data: 77.180277 2019-11-14 12:06:17.679: INFO @log_profile : T hooks: 166.557280 2019-11-14 12:06:17.679: INFO @main_loop : Epoch 10 done 2019-11-14 12:06:17.679: INFO @main_loop : Training epoch 11 2019-11-14 12:08:25.299: INFO @log_variables: train loss nanmean: 0.168214 2019-11-14 12:08:25.299: INFO @log_variables: train positive_distance nanmean: 0.603387 2019-11-14 12:08:25.299: INFO @log_variables: train negative_distance nanmean: 1.418594 2019-11-14 12:08:25.299: INFO @log_variables: valid loss nanmean: 0.319138 2019-11-14 12:08:25.299: INFO @log_variables: valid positive_distance nanmean: 0.624941 2019-11-14 12:08:25.299: INFO @log_variables: valid negative_distance nanmean: 1.392606 2019-11-14 12:08:25.299: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:11:06.724: INFO @metrics_hook: train matching accuracy: 0.9919884981598864, N=110591, DB_SIZE=110592, N_IDS=7312 2019-11-14 12:11:08.095: INFO @metrics_hook: valid matching accuracy: 0.9830436173616295, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:11:08.386: INFO @evaluate_embedding: best threshold 1.0087738931179047 2019-11-14 12:11:08.520: INFO @evaluate_embedding: positive_distances_above_threshold 256 2019-11-14 12:11:08.520: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:11:08.777: INFO @decay_lr : LR updated to `0.0009463546` 2019-11-14 12:11:09.191: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 12:11:09.240: INFO @log_profile : T train: 45.969797 2019-11-14 12:11:09.241: INFO @log_profile : T valid: 1.421981 2019-11-14 12:11:09.241: INFO @log_profile : T read data: 73.731869 2019-11-14 12:11:09.241: INFO @log_profile : T hooks: 170.357489 2019-11-14 12:11:09.242: INFO @main_loop : Epoch 11 done 2019-11-14 12:11:09.242: INFO @main_loop : Training epoch 12 2019-11-14 12:13:28.292: INFO @log_variables: train loss nanmean: 0.165980 2019-11-14 12:13:28.292: INFO @log_variables: train positive_distance nanmean: 0.603184 2019-11-14 12:13:28.292: INFO @log_variables: train negative_distance nanmean: 1.418619 2019-11-14 12:13:28.292: INFO @log_variables: valid loss nanmean: 0.313319 2019-11-14 12:13:28.292: INFO @log_variables: valid positive_distance nanmean: 0.621116 2019-11-14 12:13:28.292: INFO @log_variables: valid negative_distance nanmean: 1.391281 2019-11-14 12:13:28.292: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:16:03.931: INFO @metrics_hook: train matching accuracy: 0.9911566840277778, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-14 12:16:05.378: INFO @metrics_hook: valid matching accuracy: 0.9840034126053109, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:16:05.630: INFO @evaluate_embedding: best threshold 1.0061982572078705 2019-11-14 12:16:05.749: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:16:05.750: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:16:06.089: INFO @decay_lr : LR updated to `0.0009416228` 2019-11-14 12:16:06.505: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 12:16:06.522: INFO @log_profile : T train: 46.658337 2019-11-14 12:16:06.523: INFO @log_profile : T valid: 1.437730 2019-11-14 12:16:06.523: INFO @log_profile : T read data: 84.121064 2019-11-14 12:16:06.523: INFO @log_profile : T hooks: 164.980256 2019-11-14 12:16:06.523: INFO @main_loop : Epoch 12 done 2019-11-14 12:16:06.523: INFO @main_loop : Training epoch 13 2019-11-14 12:18:22.140: INFO @log_variables: train loss nanmean: 0.159316 2019-11-14 12:18:22.140: INFO @log_variables: train positive_distance nanmean: 0.601470 2019-11-14 12:18:22.140: INFO @log_variables: train negative_distance nanmean: 1.418644 2019-11-14 12:18:22.140: INFO @log_variables: valid loss nanmean: 0.323070 2019-11-14 12:18:22.140: INFO @log_variables: valid positive_distance nanmean: 0.624211 2019-11-14 12:18:22.140: INFO @log_variables: valid negative_distance nanmean: 1.388240 2019-11-14 12:18:22.140: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:21:03.019: INFO @metrics_hook: train matching accuracy: 0.9917625144675926, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-14 12:21:04.487: INFO @metrics_hook: valid matching accuracy: 0.9854964274288152, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:21:04.732: INFO @evaluate_embedding: best threshold 1.0062255561351778 2019-11-14 12:21:04.881: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:21:04.881: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:21:05.143: INFO @decay_lr : LR updated to `0.0009369147` 2019-11-14 12:21:05.609: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 12:21:05.645: INFO @log_profile : T train: 46.158301 2019-11-14 12:21:05.645: INFO @log_profile : T valid: 1.407681 2019-11-14 12:21:05.646: INFO @log_profile : T read data: 81.535415 2019-11-14 12:21:05.646: INFO @log_profile : T hooks: 169.947155 2019-11-14 12:21:05.646: INFO @main_loop : Epoch 13 done 2019-11-14 12:21:05.646: INFO @main_loop : Training epoch 14 2019-11-14 12:23:29.706: INFO @log_variables: train loss nanmean: 0.153028 2019-11-14 12:23:29.706: INFO @log_variables: train positive_distance nanmean: 0.599339 2019-11-14 12:23:29.707: INFO @log_variables: train negative_distance nanmean: 1.418671 2019-11-14 12:23:29.707: INFO @log_variables: valid loss nanmean: 0.335421 2019-11-14 12:23:29.707: INFO @log_variables: valid positive_distance nanmean: 0.614034 2019-11-14 12:23:29.707: INFO @log_variables: valid negative_distance nanmean: 1.378906 2019-11-14 12:23:29.707: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:26:08.278: INFO @metrics_hook: train matching accuracy: 0.9916809838140881, N=110590, DB_SIZE=110592, N_IDS=7309 2019-11-14 12:26:09.474: INFO @metrics_hook: valid matching accuracy: 0.9829369734456649, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:26:09.769: INFO @evaluate_embedding: best threshold 0.9964701533317565 2019-11-14 12:26:09.965: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:26:09.965: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:26:10.286: INFO @decay_lr : LR updated to `0.00093223015` 2019-11-14 12:26:10.288: INFO @log_profile : T train: 46.333880 2019-11-14 12:26:10.288: INFO @log_profile : T valid: 1.428300 2019-11-14 12:26:10.288: INFO @log_profile : T read data: 89.759326 2019-11-14 12:26:10.288: INFO @log_profile : T hooks: 167.032594 2019-11-14 12:26:10.288: INFO @main_loop : Epoch 14 done 2019-11-14 12:26:10.289: INFO @main_loop : Training epoch 15 2019-11-14 12:28:33.186: INFO @log_variables: train loss nanmean: 0.147309 2019-11-14 12:28:33.186: INFO @log_variables: train positive_distance nanmean: 0.596791 2019-11-14 12:28:33.186: INFO @log_variables: train negative_distance nanmean: 1.418720 2019-11-14 12:28:33.186: INFO @log_variables: valid loss nanmean: 0.312435 2019-11-14 12:28:33.187: INFO @log_variables: valid positive_distance nanmean: 0.619728 2019-11-14 12:28:33.187: INFO @log_variables: valid negative_distance nanmean: 1.388053 2019-11-14 12:28:33.187: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:31:13.232: INFO @metrics_hook: train matching accuracy: 0.9924225983796297, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-14 12:31:14.813: INFO @metrics_hook: valid matching accuracy: 0.9841100565212755, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:31:15.081: INFO @evaluate_embedding: best threshold 1.0038908720016482 2019-11-14 12:31:15.216: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:31:15.216: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:31:15.569: INFO @decay_lr : LR updated to `0.000927569` 2019-11-14 12:31:15.571: INFO @log_profile : T train: 46.530578 2019-11-14 12:31:15.571: INFO @log_profile : T valid: 1.434698 2019-11-14 12:31:15.571: INFO @log_profile : T read data: 88.108353 2019-11-14 12:31:15.571: INFO @log_profile : T hooks: 169.129605 2019-11-14 12:31:15.571: INFO @main_loop : Epoch 15 done 2019-11-14 12:31:15.571: INFO @main_loop : Training epoch 16 2019-11-14 12:33:44.850: INFO @log_variables: train loss nanmean: 0.143788 2019-11-14 12:33:44.850: INFO @log_variables: train positive_distance nanmean: 0.595661 2019-11-14 12:33:44.851: INFO @log_variables: train negative_distance nanmean: 1.418755 2019-11-14 12:33:44.851: INFO @log_variables: valid loss nanmean: 0.312303 2019-11-14 12:33:44.851: INFO @log_variables: valid positive_distance nanmean: 0.620730 2019-11-14 12:33:44.851: INFO @log_variables: valid negative_distance nanmean: 1.388737 2019-11-14 12:33:44.851: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:36:19.834: INFO @metrics_hook: train matching accuracy: 0.9915725511117541, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-14 12:36:21.330: INFO @metrics_hook: valid matching accuracy: 0.9841100565212755, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:36:21.647: INFO @evaluate_embedding: best threshold 1.0047335028648374 2019-11-14 12:36:21.753: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:36:21.753: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:36:21.980: INFO @decay_lr : LR updated to `0.0009229311` 2019-11-14 12:36:21.982: INFO @log_profile : T train: 46.726757 2019-11-14 12:36:21.982: INFO @log_profile : T valid: 1.409969 2019-11-14 12:36:21.982: INFO @log_profile : T read data: 94.495977 2019-11-14 12:36:21.982: INFO @log_profile : T hooks: 163.704221 2019-11-14 12:36:21.982: INFO @main_loop : Epoch 16 done 2019-11-14 12:36:21.982: INFO @main_loop : Training epoch 17 2019-11-14 12:38:49.603: INFO @log_variables: train loss nanmean: 0.140627 2019-11-14 12:38:49.603: INFO @log_variables: train positive_distance nanmean: 0.595712 2019-11-14 12:38:49.603: INFO @log_variables: train negative_distance nanmean: 1.418747 2019-11-14 12:38:49.603: INFO @log_variables: valid loss nanmean: 0.311740 2019-11-14 12:38:49.603: INFO @log_variables: valid positive_distance nanmean: 0.620811 2019-11-14 12:38:49.603: INFO @log_variables: valid negative_distance nanmean: 1.387098 2019-11-14 12:38:49.603: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:41:33.225: INFO @metrics_hook: train matching accuracy: 0.9924677414979519, N=110591, DB_SIZE=110592, N_IDS=7314 2019-11-14 12:41:34.618: INFO @metrics_hook: valid matching accuracy: 0.9853897835128506, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:41:34.833: INFO @evaluate_embedding: best threshold 1.0039544701576233 2019-11-14 12:41:34.934: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:41:34.934: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:41:35.164: INFO @decay_lr : LR updated to `0.0009183165` 2019-11-14 12:41:35.167: INFO @log_profile : T train: 46.461081 2019-11-14 12:41:35.167: INFO @log_profile : T valid: 1.450088 2019-11-14 12:41:35.167: INFO @log_profile : T read data: 93.246583 2019-11-14 12:41:35.167: INFO @log_profile : T hooks: 171.953983 2019-11-14 12:41:35.167: INFO @main_loop : Epoch 17 done 2019-11-14 12:41:35.167: INFO @main_loop : Training epoch 18 2019-11-14 12:44:02.301: INFO @log_variables: train loss nanmean: 0.135007 2019-11-14 12:44:02.301: INFO @log_variables: train positive_distance nanmean: 0.594236 2019-11-14 12:44:02.301: INFO @log_variables: train negative_distance nanmean: 1.418779 2019-11-14 12:44:02.301: INFO @log_variables: valid loss nanmean: 0.313266 2019-11-14 12:44:02.301: INFO @log_variables: valid positive_distance nanmean: 0.616952 2019-11-14 12:44:02.301: INFO @log_variables: valid negative_distance nanmean: 1.389525 2019-11-14 12:44:02.301: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:46:35.374: INFO @metrics_hook: train matching accuracy: 0.9923954028808855, N=110591, DB_SIZE=110592, N_IDS=7303 2019-11-14 12:46:36.853: INFO @metrics_hook: valid matching accuracy: 0.9842167004372401, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:46:37.056: INFO @evaluate_embedding: best threshold 1.003238499164581 2019-11-14 12:46:37.185: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:46:37.185: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:46:37.405: INFO @decay_lr : LR updated to `0.0009137249` 2019-11-14 12:46:37.406: INFO @log_profile : T train: 46.824342 2019-11-14 12:46:37.407: INFO @log_profile : T valid: 1.425452 2019-11-14 12:46:37.407: INFO @log_profile : T read data: 92.253175 2019-11-14 12:46:37.407: INFO @log_profile : T hooks: 161.641714 2019-11-14 12:46:37.407: INFO @main_loop : Epoch 18 done 2019-11-14 12:46:37.407: INFO @main_loop : Training epoch 19 2019-11-14 12:49:11.555: INFO @log_variables: train loss nanmean: 0.134300 2019-11-14 12:49:11.555: INFO @log_variables: train positive_distance nanmean: 0.593841 2019-11-14 12:49:11.555: INFO @log_variables: train negative_distance nanmean: 1.418786 2019-11-14 12:49:11.555: INFO @log_variables: valid loss nanmean: 0.318192 2019-11-14 12:49:11.555: INFO @log_variables: valid positive_distance nanmean: 0.614604 2019-11-14 12:49:11.556: INFO @log_variables: valid negative_distance nanmean: 1.382944 2019-11-14 12:49:11.556: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:51:52.031: INFO @metrics_hook: train matching accuracy: 0.9929470486111112, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-14 12:51:53.310: INFO @metrics_hook: valid matching accuracy: 0.9853897835128506, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:51:53.541: INFO @evaluate_embedding: best threshold 0.9987742006778717 2019-11-14 12:51:53.684: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:51:53.684: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:51:53.907: INFO @decay_lr : LR updated to `0.0009091563` 2019-11-14 12:51:53.909: INFO @log_profile : T train: 47.206653 2019-11-14 12:51:53.909: INFO @log_profile : T valid: 1.429923 2019-11-14 12:51:53.909: INFO @log_profile : T read data: 99.629689 2019-11-14 12:51:53.909: INFO @log_profile : T hooks: 168.157073 2019-11-14 12:51:53.909: INFO @main_loop : Epoch 19 done 2019-11-14 12:51:53.909: INFO @main_loop : Training epoch 20 2019-11-14 12:54:33.030: INFO @log_variables: train loss nanmean: 0.129419 2019-11-14 12:54:33.030: INFO @log_variables: train positive_distance nanmean: 0.590683 2019-11-14 12:54:33.030: INFO @log_variables: train negative_distance nanmean: 1.418821 2019-11-14 12:54:33.030: INFO @log_variables: valid loss nanmean: 0.303527 2019-11-14 12:54:33.030: INFO @log_variables: valid positive_distance nanmean: 0.620143 2019-11-14 12:54:33.030: INFO @log_variables: valid negative_distance nanmean: 1.389904 2019-11-14 12:54:33.030: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 12:57:10.998: INFO @metrics_hook: train matching accuracy: 0.9925671398860656, N=110590, DB_SIZE=110592, N_IDS=7316 2019-11-14 12:57:12.399: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 12:57:12.694: INFO @evaluate_embedding: best threshold 1.0050236284732816 2019-11-14 12:57:12.797: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 12:57:12.798: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 12:57:13.039: INFO @decay_lr : LR updated to `0.0009046105` 2019-11-14 12:57:14.030: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 12:57:14.057: INFO @log_profile : T train: 47.332676 2019-11-14 12:57:14.057: INFO @log_profile : T valid: 1.402708 2019-11-14 12:57:14.057: INFO @log_profile : T read data: 103.812238 2019-11-14 12:57:14.057: INFO @log_profile : T hooks: 167.526377 2019-11-14 12:57:14.057: INFO @main_loop : Epoch 20 done 2019-11-14 12:57:14.057: INFO @main_loop : Training epoch 21 2019-11-14 12:59:53.080: INFO @log_variables: train loss nanmean: 0.125691 2019-11-14 12:59:53.081: INFO @log_variables: train positive_distance nanmean: 0.589431 2019-11-14 12:59:53.081: INFO @log_variables: train negative_distance nanmean: 1.418823 2019-11-14 12:59:53.081: INFO @log_variables: valid loss nanmean: 0.297019 2019-11-14 12:59:53.081: INFO @log_variables: valid positive_distance nanmean: 0.621919 2019-11-14 12:59:53.081: INFO @log_variables: valid negative_distance nanmean: 1.393618 2019-11-14 12:59:53.081: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:02:30.253: INFO @metrics_hook: train matching accuracy: 0.9924858940972222, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-14 13:02:31.959: INFO @metrics_hook: valid matching accuracy: 0.9851764956809214, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:02:32.206: INFO @evaluate_embedding: best threshold 1.0077684819698334 2019-11-14 13:02:32.347: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:02:32.347: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:02:32.619: INFO @decay_lr : LR updated to `0.00090008747` 2019-11-14 13:02:32.621: INFO @log_profile : T train: 47.676974 2019-11-14 13:02:32.621: INFO @log_profile : T valid: 1.455274 2019-11-14 13:02:32.621: INFO @log_profile : T read data: 103.516584 2019-11-14 13:02:32.621: INFO @log_profile : T hooks: 165.809759 2019-11-14 13:02:32.621: INFO @main_loop : Epoch 21 done 2019-11-14 13:02:32.621: INFO @main_loop : Training epoch 22 2019-11-14 13:05:09.984: INFO @log_variables: train loss nanmean: 0.124812 2019-11-14 13:05:09.985: INFO @log_variables: train positive_distance nanmean: 0.589679 2019-11-14 13:05:09.985: INFO @log_variables: train negative_distance nanmean: 1.418838 2019-11-14 13:05:09.985: INFO @log_variables: valid loss nanmean: 0.300188 2019-11-14 13:05:09.986: INFO @log_variables: valid positive_distance nanmean: 0.627914 2019-11-14 13:05:09.986: INFO @log_variables: valid negative_distance nanmean: 1.390919 2019-11-14 13:05:09.986: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:07:52.313: INFO @metrics_hook: train matching accuracy: 0.9925128854326792, N=110590, DB_SIZE=110592, N_IDS=7312 2019-11-14 13:07:53.706: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:07:53.929: INFO @evaluate_embedding: best threshold 1.0094166100025177 2019-11-14 13:07:54.108: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:07:54.108: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:07:54.424: INFO @decay_lr : LR updated to `0.000895587` 2019-11-14 13:07:54.890: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 13:07:54.907: INFO @log_profile : T train: 47.060447 2019-11-14 13:07:54.907: INFO @log_profile : T valid: 1.437406 2019-11-14 13:07:54.907: INFO @log_profile : T read data: 102.317875 2019-11-14 13:07:54.907: INFO @log_profile : T hooks: 171.392901 2019-11-14 13:07:54.918: INFO @main_loop : Epoch 22 done 2019-11-14 13:07:54.918: INFO @main_loop : Training epoch 23 2019-11-14 13:10:41.062: INFO @log_variables: train loss nanmean: 0.121621 2019-11-14 13:10:41.062: INFO @log_variables: train positive_distance nanmean: 0.587816 2019-11-14 13:10:41.062: INFO @log_variables: train negative_distance nanmean: 1.418877 2019-11-14 13:10:41.062: INFO @log_variables: valid loss nanmean: 0.305372 2019-11-14 13:10:41.062: INFO @log_variables: valid positive_distance nanmean: 0.624789 2019-11-14 13:10:41.062: INFO @log_variables: valid negative_distance nanmean: 1.385378 2019-11-14 13:10:41.062: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:13:19.421: INFO @metrics_hook: train matching accuracy: 0.9921965422453703, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-14 13:13:20.835: INFO @metrics_hook: valid matching accuracy: 0.9851764956809214, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:13:21.125: INFO @evaluate_embedding: best threshold 1.005083590745926 2019-11-14 13:13:21.273: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:13:21.274: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:13:21.610: INFO @decay_lr : LR updated to `0.0008911091` 2019-11-14 13:13:21.612: INFO @log_profile : T train: 47.530601 2019-11-14 13:13:21.612: INFO @log_profile : T valid: 1.415824 2019-11-14 13:13:21.612: INFO @log_profile : T read data: 110.795130 2019-11-14 13:13:21.612: INFO @log_profile : T hooks: 166.882184 2019-11-14 13:13:21.612: INFO @main_loop : Epoch 23 done 2019-11-14 13:13:21.612: INFO @main_loop : Training epoch 24 2019-11-14 13:16:04.342: INFO @log_variables: train loss nanmean: 0.117077 2019-11-14 13:16:04.342: INFO @log_variables: train positive_distance nanmean: 0.587353 2019-11-14 13:16:04.343: INFO @log_variables: train negative_distance nanmean: 1.418881 2019-11-14 13:16:04.343: INFO @log_variables: valid loss nanmean: 0.297988 2019-11-14 13:16:04.343: INFO @log_variables: valid positive_distance nanmean: 0.629986 2019-11-14 13:16:04.343: INFO @log_variables: valid negative_distance nanmean: 1.390207 2019-11-14 13:16:04.343: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:18:44.237: INFO @metrics_hook: train matching accuracy: 0.9928293697440999, N=110590, DB_SIZE=110592, N_IDS=7309 2019-11-14 13:18:45.772: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:18:46.093: INFO @evaluate_embedding: best threshold 1.0100963711738586 2019-11-14 13:18:46.208: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:18:46.208: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:18:46.554: INFO @decay_lr : LR updated to `0.00088665355` 2019-11-14 13:18:47.035: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 13:18:47.037: INFO @log_profile : T train: 47.712832 2019-11-14 13:18:47.038: INFO @log_profile : T valid: 1.441943 2019-11-14 13:18:47.038: INFO @log_profile : T read data: 107.220147 2019-11-14 13:18:47.038: INFO @log_profile : T hooks: 168.977885 2019-11-14 13:18:47.038: INFO @main_loop : Epoch 24 done 2019-11-14 13:18:47.038: INFO @main_loop : Training epoch 25 2019-11-14 13:21:32.954: INFO @log_variables: train loss nanmean: 0.118077 2019-11-14 13:21:32.954: INFO @log_variables: train positive_distance nanmean: 0.587455 2019-11-14 13:21:32.954: INFO @log_variables: train negative_distance nanmean: 1.418873 2019-11-14 13:21:32.954: INFO @log_variables: valid loss nanmean: 0.290401 2019-11-14 13:21:32.954: INFO @log_variables: valid positive_distance nanmean: 0.629127 2019-11-14 13:21:32.955: INFO @log_variables: valid negative_distance nanmean: 1.391036 2019-11-14 13:21:32.955: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:24:11.296: INFO @metrics_hook: train matching accuracy: 0.9928113499290178, N=110591, DB_SIZE=110592, N_IDS=7300 2019-11-14 13:24:12.697: INFO @metrics_hook: valid matching accuracy: 0.9850698517649568, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:24:12.969: INFO @evaluate_embedding: best threshold 1.0100815892219543 2019-11-14 13:24:13.072: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:24:13.072: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:24:13.410: INFO @decay_lr : LR updated to `0.0008822203` 2019-11-14 13:24:13.412: INFO @log_profile : T train: 47.439855 2019-11-14 13:24:13.412: INFO @log_profile : T valid: 1.419336 2019-11-14 13:24:13.412: INFO @log_profile : T read data: 110.393173 2019-11-14 13:24:13.412: INFO @log_profile : T hooks: 167.030073 2019-11-14 13:24:13.413: INFO @main_loop : Epoch 25 done 2019-11-14 13:24:13.413: INFO @main_loop : Training epoch 26 2019-11-14 13:27:00.827: INFO @log_variables: train loss nanmean: 0.116127 2019-11-14 13:27:00.828: INFO @log_variables: train positive_distance nanmean: 0.587402 2019-11-14 13:27:00.828: INFO @log_variables: train negative_distance nanmean: 1.418894 2019-11-14 13:27:00.828: INFO @log_variables: valid loss nanmean: 0.288554 2019-11-14 13:27:00.828: INFO @log_variables: valid positive_distance nanmean: 0.627072 2019-11-14 13:27:00.828: INFO @log_variables: valid negative_distance nanmean: 1.392005 2019-11-14 13:27:00.828: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:29:40.616: INFO @metrics_hook: train matching accuracy: 0.9931369357638888, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-14 13:29:42.142: INFO @metrics_hook: valid matching accuracy: 0.9851764956809214, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:29:42.299: INFO @evaluate_embedding: best threshold 1.0095383524894712 2019-11-14 13:29:42.379: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:29:42.380: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:29:42.571: INFO @decay_lr : LR updated to `0.0008778092` 2019-11-14 13:29:42.573: INFO @log_profile : T train: 47.803289 2019-11-14 13:29:42.573: INFO @log_profile : T valid: 1.407870 2019-11-14 13:29:42.573: INFO @log_profile : T read data: 111.519592 2019-11-14 13:29:42.573: INFO @log_profile : T hooks: 168.314184 2019-11-14 13:29:42.573: INFO @main_loop : Epoch 26 done 2019-11-14 13:29:42.573: INFO @main_loop : Training epoch 27 2019-11-14 13:32:31.604: INFO @log_variables: train loss nanmean: 0.113971 2019-11-14 13:32:31.604: INFO @log_variables: train positive_distance nanmean: 0.587173 2019-11-14 13:32:31.604: INFO @log_variables: train negative_distance nanmean: 1.418908 2019-11-14 13:32:31.604: INFO @log_variables: valid loss nanmean: 0.307172 2019-11-14 13:32:31.604: INFO @log_variables: valid positive_distance nanmean: 0.630834 2019-11-14 13:32:31.604: INFO @log_variables: valid negative_distance nanmean: 1.392301 2019-11-14 13:32:31.604: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:35:14.982: INFO @metrics_hook: train matching accuracy: 0.9930373451487476, N=110590, DB_SIZE=110592, N_IDS=7306 2019-11-14 13:35:16.192: INFO @metrics_hook: valid matching accuracy: 0.985283139596886, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:35:16.355: INFO @evaluate_embedding: best threshold 1.0115672945976255 2019-11-14 13:35:16.435: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:35:16.436: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:35:16.604: INFO @decay_lr : LR updated to `0.00087342015` 2019-11-14 13:35:16.606: INFO @log_profile : T train: 47.380642 2019-11-14 13:35:16.606: INFO @log_profile : T valid: 1.483771 2019-11-14 13:35:16.606: INFO @log_profile : T read data: 111.707035 2019-11-14 13:35:16.606: INFO @log_profile : T hooks: 173.388759 2019-11-14 13:35:16.606: INFO @main_loop : Epoch 27 done 2019-11-14 13:35:16.606: INFO @main_loop : Training epoch 28 2019-11-14 13:38:02.026: INFO @log_variables: train loss nanmean: 0.109138 2019-11-14 13:38:02.026: INFO @log_variables: train positive_distance nanmean: 0.583769 2019-11-14 13:38:02.026: INFO @log_variables: train negative_distance nanmean: 1.418930 2019-11-14 13:38:02.026: INFO @log_variables: valid loss nanmean: 0.296796 2019-11-14 13:38:02.026: INFO @log_variables: valid positive_distance nanmean: 0.631527 2019-11-14 13:38:02.027: INFO @log_variables: valid negative_distance nanmean: 1.392065 2019-11-14 13:38:02.027: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:40:42.339: INFO @metrics_hook: train matching accuracy: 0.9931911892361112, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-14 13:40:43.889: INFO @metrics_hook: valid matching accuracy: 0.9856030713447798, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:40:44.064: INFO @evaluate_embedding: best threshold 1.011796176433563 2019-11-14 13:40:44.150: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:40:44.151: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:40:44.319: INFO @decay_lr : LR updated to `0.00086905307` 2019-11-14 13:40:44.321: INFO @log_profile : T train: 47.214977 2019-11-14 13:40:44.321: INFO @log_profile : T valid: 1.470110 2019-11-14 13:40:44.321: INFO @log_profile : T read data: 107.461328 2019-11-14 13:40:44.321: INFO @log_profile : T hooks: 171.488511 2019-11-14 13:40:44.321: INFO @main_loop : Epoch 28 done 2019-11-14 13:40:44.321: INFO @main_loop : Training epoch 29 2019-11-14 13:43:26.140: INFO @log_variables: train loss nanmean: 0.110144 2019-11-14 13:43:26.140: INFO @log_variables: train positive_distance nanmean: 0.585224 2019-11-14 13:43:26.140: INFO @log_variables: train negative_distance nanmean: 1.418935 2019-11-14 13:43:26.141: INFO @log_variables: valid loss nanmean: 0.302407 2019-11-14 13:43:26.141: INFO @log_variables: valid positive_distance nanmean: 0.631777 2019-11-14 13:43:26.141: INFO @log_variables: valid negative_distance nanmean: 1.392756 2019-11-14 13:43:26.141: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:46:04.247: INFO @metrics_hook: train matching accuracy: 0.9923049796095523, N=110591, DB_SIZE=110592, N_IDS=7306 2019-11-14 13:46:05.741: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:46:05.934: INFO @evaluate_embedding: best threshold 1.0122664272785185 2019-11-14 13:46:06.019: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:46:06.020: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:46:06.216: INFO @decay_lr : LR updated to `0.0008647078` 2019-11-14 13:46:06.218: INFO @log_profile : T train: 46.725058 2019-11-14 13:46:06.218: INFO @log_profile : T valid: 1.600467 2019-11-14 13:46:06.218: INFO @log_profile : T read data: 104.450735 2019-11-14 13:46:06.218: INFO @log_profile : T hooks: 169.046157 2019-11-14 13:46:06.218: INFO @main_loop : Epoch 29 done 2019-11-14 13:46:06.218: INFO @main_loop : Training epoch 30 2019-11-14 13:48:44.436: INFO @log_variables: train loss nanmean: 0.108159 2019-11-14 13:48:44.437: INFO @log_variables: train positive_distance nanmean: 0.583810 2019-11-14 13:48:44.437: INFO @log_variables: train negative_distance nanmean: 1.418942 2019-11-14 13:48:44.437: INFO @log_variables: valid loss nanmean: 0.290333 2019-11-14 13:48:44.437: INFO @log_variables: valid positive_distance nanmean: 0.633217 2019-11-14 13:48:44.437: INFO @log_variables: valid negative_distance nanmean: 1.393291 2019-11-14 13:48:44.438: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:51:19.654: INFO @metrics_hook: train matching accuracy: 0.9933539496527778, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-14 13:51:21.242: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:51:21.410: INFO @evaluate_embedding: best threshold 1.013254016637802 2019-11-14 13:51:21.519: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:51:21.519: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:51:21.738: INFO @decay_lr : LR updated to `0.00086038426` 2019-11-14 13:51:21.740: INFO @log_profile : T train: 46.595151 2019-11-14 13:51:21.740: INFO @log_profile : T valid: 1.537623 2019-11-14 13:51:21.740: INFO @log_profile : T read data: 100.373646 2019-11-14 13:51:21.740: INFO @log_profile : T hooks: 166.940894 2019-11-14 13:51:21.740: INFO @main_loop : Epoch 30 done 2019-11-14 13:51:21.740: INFO @main_loop : Training epoch 31 2019-11-14 13:54:00.185: INFO @log_variables: train loss nanmean: 0.106318 2019-11-14 13:54:00.185: INFO @log_variables: train positive_distance nanmean: 0.585207 2019-11-14 13:54:00.185: INFO @log_variables: train negative_distance nanmean: 1.418936 2019-11-14 13:54:00.185: INFO @log_variables: valid loss nanmean: 0.294295 2019-11-14 13:54:00.185: INFO @log_variables: valid positive_distance nanmean: 0.637944 2019-11-14 13:54:00.185: INFO @log_variables: valid negative_distance nanmean: 1.393943 2019-11-14 13:54:00.185: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 13:56:40.366: INFO @metrics_hook: train matching accuracy: 0.9931821469907407, N=110592, DB_SIZE=110592, N_IDS=7317 2019-11-14 13:56:41.705: INFO @metrics_hook: valid matching accuracy: 0.985816359176709, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 13:56:41.911: INFO @evaluate_embedding: best threshold 1.0159430801868439 2019-11-14 13:56:42.004: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 13:56:42.005: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 13:56:42.256: INFO @decay_lr : LR updated to `0.00085608236` 2019-11-14 13:56:42.257: INFO @log_profile : T train: 46.801763 2019-11-14 13:56:42.258: INFO @log_profile : T valid: 1.491316 2019-11-14 13:56:42.258: INFO @log_profile : T read data: 101.199365 2019-11-14 13:56:42.258: INFO @log_profile : T hooks: 170.950661 2019-11-14 13:56:42.258: INFO @main_loop : Epoch 31 done 2019-11-14 13:56:42.258: INFO @main_loop : Training epoch 32 2019-11-14 13:59:15.099: INFO @log_variables: train loss nanmean: 0.104336 2019-11-14 13:59:15.099: INFO @log_variables: train positive_distance nanmean: 0.583957 2019-11-14 13:59:15.099: INFO @log_variables: train negative_distance nanmean: 1.418942 2019-11-14 13:59:15.099: INFO @log_variables: valid loss nanmean: 0.292778 2019-11-14 13:59:15.100: INFO @log_variables: valid positive_distance nanmean: 0.630394 2019-11-14 13:59:15.100: INFO @log_variables: valid negative_distance nanmean: 1.391336 2019-11-14 13:59:15.100: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:01:53.753: INFO @metrics_hook: train matching accuracy: 0.9929017732003509, N=110591, DB_SIZE=110592, N_IDS=7310 2019-11-14 14:01:55.316: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:01:55.533: INFO @evaluate_embedding: best threshold 1.0108651816844938 2019-11-14 14:01:55.614: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:01:55.614: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:01:55.803: INFO @decay_lr : LR updated to `0.00085180195` 2019-11-14 14:01:55.804: INFO @log_profile : T train: 47.455999 2019-11-14 14:01:55.805: INFO @log_profile : T valid: 1.469611 2019-11-14 14:01:55.805: INFO @log_profile : T read data: 94.626662 2019-11-14 14:01:55.805: INFO @log_profile : T hooks: 169.918432 2019-11-14 14:01:55.805: INFO @main_loop : Epoch 32 done 2019-11-14 14:01:55.805: INFO @main_loop : Training epoch 33 2019-11-14 14:04:25.394: INFO @log_variables: train loss nanmean: 0.102240 2019-11-14 14:04:25.394: INFO @log_variables: train positive_distance nanmean: 0.583202 2019-11-14 14:04:25.394: INFO @log_variables: train negative_distance nanmean: 1.418958 2019-11-14 14:04:25.395: INFO @log_variables: valid loss nanmean: 0.283692 2019-11-14 14:04:25.395: INFO @log_variables: valid positive_distance nanmean: 0.631534 2019-11-14 14:04:25.395: INFO @log_variables: valid negative_distance nanmean: 1.394244 2019-11-14 14:04:25.395: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:07:04.098: INFO @metrics_hook: train matching accuracy: 0.9933358049027498, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-14 14:07:05.356: INFO @metrics_hook: valid matching accuracy: 0.9857097152607444, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:07:05.544: INFO @evaluate_embedding: best threshold 1.012888967990875 2019-11-14 14:07:05.635: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:07:05.635: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:07:05.835: INFO @decay_lr : LR updated to `0.00084754295` 2019-11-14 14:07:05.837: INFO @log_profile : T train: 46.228625 2019-11-14 14:07:05.837: INFO @log_profile : T valid: 1.517177 2019-11-14 14:07:05.837: INFO @log_profile : T read data: 92.555102 2019-11-14 14:07:05.837: INFO @log_profile : T hooks: 169.656357 2019-11-14 14:07:05.838: INFO @main_loop : Epoch 33 done 2019-11-14 14:07:05.838: INFO @main_loop : Training epoch 34 2019-11-14 14:09:31.116: INFO @log_variables: train loss nanmean: 0.099752 2019-11-14 14:09:31.127: INFO @log_variables: train positive_distance nanmean: 0.582425 2019-11-14 14:09:31.129: INFO @log_variables: train negative_distance nanmean: 1.418967 2019-11-14 14:09:31.130: INFO @log_variables: valid loss nanmean: 0.290757 2019-11-14 14:09:31.130: INFO @log_variables: valid positive_distance nanmean: 0.638781 2019-11-14 14:09:31.130: INFO @log_variables: valid negative_distance nanmean: 1.393740 2019-11-14 14:09:31.130: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:12:13.457: INFO @metrics_hook: train matching accuracy: 0.9933177806712963, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-14 14:12:15.009: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:12:15.201: INFO @evaluate_embedding: best threshold 1.0162606537342072 2019-11-14 14:12:15.295: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:12:15.296: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:12:15.493: INFO @decay_lr : LR updated to `0.00084330526` 2019-11-14 14:12:15.495: INFO @log_profile : T train: 46.700465 2019-11-14 14:12:15.495: INFO @log_profile : T valid: 1.473169 2019-11-14 14:12:15.495: INFO @log_profile : T read data: 86.756060 2019-11-14 14:12:15.495: INFO @log_profile : T hooks: 174.657371 2019-11-14 14:12:15.496: INFO @main_loop : Epoch 34 done 2019-11-14 14:12:15.496: INFO @main_loop : Training epoch 35 2019-11-14 14:14:37.234: INFO @log_variables: train loss nanmean: 0.098506 2019-11-14 14:14:37.235: INFO @log_variables: train positive_distance nanmean: 0.580774 2019-11-14 14:14:37.235: INFO @log_variables: train negative_distance nanmean: 1.418983 2019-11-14 14:14:37.235: INFO @log_variables: valid loss nanmean: 0.303131 2019-11-14 14:14:37.235: INFO @log_variables: valid positive_distance nanmean: 0.633586 2019-11-14 14:14:37.235: INFO @log_variables: valid negative_distance nanmean: 1.391494 2019-11-14 14:14:37.236: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:17:14.002: INFO @metrics_hook: train matching accuracy: 0.9932183159722222, N=110592, DB_SIZE=110592, N_IDS=7326 2019-11-14 14:17:15.739: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:17:15.938: INFO @evaluate_embedding: best threshold 1.0125402808189392 2019-11-14 14:17:16.039: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:17:16.039: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:17:16.230: INFO @decay_lr : LR updated to `0.00083908875` 2019-11-14 14:17:16.232: INFO @log_profile : T train: 46.160199 2019-11-14 14:17:16.232: INFO @log_profile : T valid: 1.422335 2019-11-14 14:17:16.232: INFO @log_profile : T read data: 85.759537 2019-11-14 14:17:16.232: INFO @log_profile : T hooks: 167.304610 2019-11-14 14:17:16.233: INFO @main_loop : Epoch 35 done 2019-11-14 14:17:16.233: INFO @main_loop : Training epoch 36 2019-11-14 14:19:31.296: INFO @log_variables: train loss nanmean: 0.097899 2019-11-14 14:19:31.296: INFO @log_variables: train positive_distance nanmean: 0.580396 2019-11-14 14:19:31.297: INFO @log_variables: train negative_distance nanmean: 1.418977 2019-11-14 14:19:31.297: INFO @log_variables: valid loss nanmean: 0.294375 2019-11-14 14:19:31.297: INFO @log_variables: valid positive_distance nanmean: 0.640878 2019-11-14 14:19:31.297: INFO @log_variables: valid negative_distance nanmean: 1.393929 2019-11-14 14:19:31.297: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:22:16.234: INFO @metrics_hook: train matching accuracy: 0.9929018373842593, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-14 14:22:17.922: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:22:18.593: INFO @evaluate_embedding: best threshold 1.0174033641815188 2019-11-14 14:22:18.673: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:22:18.673: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:22:18.854: INFO @decay_lr : LR updated to `0.0008348933` 2019-11-14 14:22:18.855: INFO @log_profile : T train: 45.949946 2019-11-14 14:22:18.856: INFO @log_profile : T valid: 1.487329 2019-11-14 14:22:18.856: INFO @log_profile : T read data: 77.861860 2019-11-14 14:22:18.856: INFO @log_profile : T hooks: 177.244581 2019-11-14 14:22:18.856: INFO @main_loop : Epoch 36 done 2019-11-14 14:22:18.856: INFO @main_loop : Training epoch 37 2019-11-14 14:24:33.783: INFO @log_variables: train loss nanmean: 0.096624 2019-11-14 14:24:33.784: INFO @log_variables: train positive_distance nanmean: 0.581341 2019-11-14 14:24:33.784: INFO @log_variables: train negative_distance nanmean: 1.418989 2019-11-14 14:24:33.784: INFO @log_variables: valid loss nanmean: 0.285305 2019-11-14 14:24:33.784: INFO @log_variables: valid positive_distance nanmean: 0.640832 2019-11-14 14:24:33.784: INFO @log_variables: valid negative_distance nanmean: 1.394711 2019-11-14 14:24:33.785: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:27:14.867: INFO @metrics_hook: train matching accuracy: 0.9927933304398148, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-14 14:27:16.308: INFO @metrics_hook: valid matching accuracy: 0.985816359176709, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:27:16.541: INFO @evaluate_embedding: best threshold 1.017771929502487 2019-11-14 14:27:16.633: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:27:16.633: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:27:16.846: INFO @decay_lr : LR updated to `0.00083071884` 2019-11-14 14:27:16.848: INFO @log_profile : T train: 46.225576 2019-11-14 14:27:16.848: INFO @log_profile : T valid: 1.509668 2019-11-14 14:27:16.848: INFO @log_profile : T read data: 77.464115 2019-11-14 14:27:16.848: INFO @log_profile : T hooks: 172.713107 2019-11-14 14:27:16.848: INFO @main_loop : Epoch 37 done 2019-11-14 14:27:16.848: INFO @main_loop : Training epoch 38 2019-11-14 14:29:33.946: INFO @log_variables: train loss nanmean: 0.095763 2019-11-14 14:29:33.946: INFO @log_variables: train positive_distance nanmean: 0.580286 2019-11-14 14:29:33.946: INFO @log_variables: train negative_distance nanmean: 1.419006 2019-11-14 14:29:33.946: INFO @log_variables: valid loss nanmean: 0.289715 2019-11-14 14:29:33.947: INFO @log_variables: valid positive_distance nanmean: 0.637472 2019-11-14 14:29:33.947: INFO @log_variables: valid negative_distance nanmean: 1.393843 2019-11-14 14:29:33.947: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:32:12.295: INFO @metrics_hook: train matching accuracy: 0.992919921875, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-14 14:32:13.922: INFO @metrics_hook: valid matching accuracy: 0.9857097152607444, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:32:14.096: INFO @evaluate_embedding: best threshold 1.0156577527523043 2019-11-14 14:32:14.184: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:32:14.184: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:32:14.397: INFO @decay_lr : LR updated to `0.00082656526` 2019-11-14 14:32:14.399: INFO @log_profile : T train: 45.607498 2019-11-14 14:32:14.399: INFO @log_profile : T valid: 1.459530 2019-11-14 14:32:14.399: INFO @log_profile : T read data: 80.206043 2019-11-14 14:32:14.399: INFO @log_profile : T hooks: 170.203870 2019-11-14 14:32:14.399: INFO @main_loop : Epoch 38 done 2019-11-14 14:32:14.400: INFO @main_loop : Training epoch 39 2019-11-14 14:34:22.893: INFO @log_variables: train loss nanmean: 0.094727 2019-11-14 14:34:22.905: INFO @log_variables: train positive_distance nanmean: 0.581205 2019-11-14 14:34:22.906: INFO @log_variables: train negative_distance nanmean: 1.418993 2019-11-14 14:34:22.906: INFO @log_variables: valid loss nanmean: 0.288737 2019-11-14 14:34:22.909: INFO @log_variables: valid positive_distance nanmean: 0.637708 2019-11-14 14:34:22.909: INFO @log_variables: valid negative_distance nanmean: 1.393772 2019-11-14 14:34:22.909: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:36:57.770: INFO @metrics_hook: train matching accuracy: 0.9930374710648148, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-14 14:36:59.008: INFO @metrics_hook: valid matching accuracy: 0.985816359176709, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:36:59.174: INFO @evaluate_embedding: best threshold 1.0157399177551267 2019-11-14 14:36:59.259: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:36:59.259: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:36:59.488: INFO @decay_lr : LR updated to `0.00082243246` 2019-11-14 14:36:59.490: INFO @log_profile : T train: 45.977139 2019-11-14 14:36:59.490: INFO @log_profile : T valid: 1.486643 2019-11-14 14:36:59.491: INFO @log_profile : T read data: 71.705627 2019-11-14 14:36:59.491: INFO @log_profile : T hooks: 165.811391 2019-11-14 14:36:59.491: INFO @main_loop : Epoch 39 done 2019-11-14 14:36:59.491: INFO @main_loop : Training epoch 40 2019-11-14 14:39:07.069: INFO @log_variables: train loss nanmean: 0.093682 2019-11-14 14:39:07.069: INFO @log_variables: train positive_distance nanmean: 0.580567 2019-11-14 14:39:07.069: INFO @log_variables: train negative_distance nanmean: 1.418996 2019-11-14 14:39:07.070: INFO @log_variables: valid loss nanmean: 0.281957 2019-11-14 14:39:07.070: INFO @log_variables: valid positive_distance nanmean: 0.640184 2019-11-14 14:39:07.070: INFO @log_variables: valid negative_distance nanmean: 1.395769 2019-11-14 14:39:07.070: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:41:47.740: INFO @metrics_hook: train matching accuracy: 0.9933086779213498, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-14 14:41:49.202: INFO @metrics_hook: valid matching accuracy: 0.9859230030926736, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:41:49.412: INFO @evaluate_embedding: best threshold 1.017976850271225 2019-11-14 14:41:49.507: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:41:49.508: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:41:49.768: INFO @decay_lr : LR updated to `0.0008183203` 2019-11-14 14:41:49.770: INFO @log_profile : T train: 46.159286 2019-11-14 14:41:49.770: INFO @log_profile : T valid: 1.518269 2019-11-14 14:41:49.771: INFO @log_profile : T read data: 70.376963 2019-11-14 14:41:49.771: INFO @log_profile : T hooks: 172.140042 2019-11-14 14:41:49.771: INFO @main_loop : Epoch 40 done 2019-11-14 14:41:49.771: INFO @main_loop : Training epoch 41 2019-11-14 14:43:49.379: INFO @log_variables: train loss nanmean: 0.093809 2019-11-14 14:43:49.379: INFO @log_variables: train positive_distance nanmean: 0.581442 2019-11-14 14:43:49.379: INFO @log_variables: train negative_distance nanmean: 1.419030 2019-11-14 14:43:49.379: INFO @log_variables: valid loss nanmean: 0.286534 2019-11-14 14:43:49.379: INFO @log_variables: valid positive_distance nanmean: 0.643554 2019-11-14 14:43:49.380: INFO @log_variables: valid negative_distance nanmean: 1.395382 2019-11-14 14:43:49.380: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:46:29.359: INFO @metrics_hook: train matching accuracy: 0.9925582320601852, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-14 14:46:31.028: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:46:31.207: INFO @evaluate_embedding: best threshold 1.0194680988788605 2019-11-14 14:46:31.289: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:46:31.289: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:46:31.486: INFO @decay_lr : LR updated to `0.0008142287` 2019-11-14 14:46:31.487: INFO @log_profile : T train: 45.333328 2019-11-14 14:46:31.487: INFO @log_profile : T valid: 1.452988 2019-11-14 14:46:31.487: INFO @log_profile : T read data: 63.867557 2019-11-14 14:46:31.487: INFO @log_profile : T hooks: 170.970026 2019-11-14 14:46:31.488: INFO @main_loop : Epoch 41 done 2019-11-14 14:46:31.488: INFO @main_loop : Training epoch 42 2019-11-14 14:48:34.459: INFO @log_variables: train loss nanmean: 0.092395 2019-11-14 14:48:34.459: INFO @log_variables: train positive_distance nanmean: 0.579921 2019-11-14 14:48:34.465: INFO @log_variables: train negative_distance nanmean: 1.419038 2019-11-14 14:48:34.465: INFO @log_variables: valid loss nanmean: 0.299996 2019-11-14 14:48:34.465: INFO @log_variables: valid positive_distance nanmean: 0.646610 2019-11-14 14:48:34.465: INFO @log_variables: valid negative_distance nanmean: 1.393141 2019-11-14 14:48:34.466: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:51:14.340: INFO @metrics_hook: train matching accuracy: 0.9932001699957501, N=110591, DB_SIZE=110592, N_IDS=7312 2019-11-14 14:51:15.655: INFO @metrics_hook: valid matching accuracy: 0.9859230030926736, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:51:15.841: INFO @evaluate_embedding: best threshold 1.0198758244514468 2019-11-14 14:51:15.921: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:51:15.922: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:51:16.104: INFO @decay_lr : LR updated to `0.00081015757` 2019-11-14 14:51:16.106: INFO @log_profile : T train: 45.724087 2019-11-14 14:51:16.106: INFO @log_profile : T valid: 1.499446 2019-11-14 14:51:16.106: INFO @log_profile : T read data: 66.108795 2019-11-14 14:51:16.106: INFO @log_profile : T hooks: 171.199481 2019-11-14 14:51:16.106: INFO @main_loop : Epoch 42 done 2019-11-14 14:51:16.106: INFO @main_loop : Training epoch 43 2019-11-14 14:53:17.043: INFO @log_variables: train loss nanmean: 0.089777 2019-11-14 14:53:17.043: INFO @log_variables: train positive_distance nanmean: 0.580366 2019-11-14 14:53:17.043: INFO @log_variables: train negative_distance nanmean: 1.419032 2019-11-14 14:53:17.043: INFO @log_variables: valid loss nanmean: 0.283248 2019-11-14 14:53:17.044: INFO @log_variables: valid positive_distance nanmean: 0.639657 2019-11-14 14:53:17.044: INFO @log_variables: valid negative_distance nanmean: 1.395487 2019-11-14 14:53:17.044: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 14:55:55.921: INFO @metrics_hook: train matching accuracy: 0.9931188512731481, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-14 14:55:57.630: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 14:55:57.861: INFO @evaluate_embedding: best threshold 1.0175722539424896 2019-11-14 14:55:57.951: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 14:55:57.951: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 14:55:58.174: INFO @decay_lr : LR updated to `0.0008061068` 2019-11-14 14:55:58.496: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 14:55:58.521: INFO @log_profile : T train: 45.477969 2019-11-14 14:55:58.521: INFO @log_profile : T valid: 1.554595 2019-11-14 14:55:58.521: INFO @log_profile : T read data: 64.221339 2019-11-14 14:55:58.521: INFO @log_profile : T hooks: 171.087221 2019-11-14 14:55:58.521: INFO @main_loop : Epoch 43 done 2019-11-14 14:55:58.521: INFO @main_loop : Training epoch 44 2019-11-14 14:57:58.852: INFO @log_variables: train loss nanmean: 0.090085 2019-11-14 14:57:58.852: INFO @log_variables: train positive_distance nanmean: 0.579884 2019-11-14 14:57:58.852: INFO @log_variables: train negative_distance nanmean: 1.419036 2019-11-14 14:57:58.852: INFO @log_variables: valid loss nanmean: 0.297126 2019-11-14 14:57:58.852: INFO @log_variables: valid positive_distance nanmean: 0.644993 2019-11-14 14:57:58.852: INFO @log_variables: valid negative_distance nanmean: 1.393830 2019-11-14 14:57:58.852: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:00:39.289: INFO @metrics_hook: train matching accuracy: 0.9929198578546174, N=110591, DB_SIZE=110592, N_IDS=7313 2019-11-14 15:00:40.687: INFO @metrics_hook: valid matching accuracy: 0.9853897835128506, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:00:40.892: INFO @evaluate_embedding: best threshold 1.0194111764431 2019-11-14 15:00:40.991: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:00:40.991: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:00:41.222: INFO @decay_lr : LR updated to `0.00080207625` 2019-11-14 15:00:41.224: INFO @log_profile : T train: 45.575295 2019-11-14 15:00:41.224: INFO @log_profile : T valid: 1.481139 2019-11-14 15:00:41.224: INFO @log_profile : T read data: 64.205801 2019-11-14 15:00:41.224: INFO @log_profile : T hooks: 171.354658 2019-11-14 15:00:41.224: INFO @main_loop : Epoch 44 done 2019-11-14 15:00:41.224: INFO @main_loop : Training epoch 45 2019-11-14 15:02:37.951: INFO @log_variables: train loss nanmean: 0.088535 2019-11-14 15:02:37.952: INFO @log_variables: train positive_distance nanmean: 0.579293 2019-11-14 15:02:37.952: INFO @log_variables: train negative_distance nanmean: 1.419004 2019-11-14 15:02:37.952: INFO @log_variables: valid loss nanmean: 0.278972 2019-11-14 15:02:37.952: INFO @log_variables: valid positive_distance nanmean: 0.644015 2019-11-14 15:02:37.953: INFO @log_variables: valid negative_distance nanmean: 1.395014 2019-11-14 15:02:37.953: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:05:14.889: INFO @metrics_hook: train matching accuracy: 0.9931369357638888, N=110592, DB_SIZE=110592, N_IDS=7300 2019-11-14 15:05:16.695: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:05:16.882: INFO @evaluate_embedding: best threshold 1.0195144712924957 2019-11-14 15:05:16.973: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:05:16.973: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:05:17.211: INFO @decay_lr : LR updated to `0.00079806586` 2019-11-14 15:05:17.496: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 15:05:17.523: INFO @log_profile : T train: 45.645818 2019-11-14 15:05:17.524: INFO @log_profile : T valid: 1.389203 2019-11-14 15:05:17.524: INFO @log_profile : T read data: 63.322995 2019-11-14 15:05:17.524: INFO @log_profile : T hooks: 165.867593 2019-11-14 15:05:17.524: INFO @main_loop : Epoch 45 done 2019-11-14 15:05:17.524: INFO @main_loop : Training epoch 46 2019-11-14 15:07:16.823: INFO @log_variables: train loss nanmean: 0.087860 2019-11-14 15:07:16.824: INFO @log_variables: train positive_distance nanmean: 0.579905 2019-11-14 15:07:16.824: INFO @log_variables: train negative_distance nanmean: 1.419028 2019-11-14 15:07:16.824: INFO @log_variables: valid loss nanmean: 0.290020 2019-11-14 15:07:16.824: INFO @log_variables: valid positive_distance nanmean: 0.641914 2019-11-14 15:07:16.824: INFO @log_variables: valid negative_distance nanmean: 1.391856 2019-11-14 15:07:16.824: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:09:52.848: INFO @metrics_hook: train matching accuracy: 0.992820392256151, N=110591, DB_SIZE=110592, N_IDS=7313 2019-11-14 15:09:54.045: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:09:54.281: INFO @evaluate_embedding: best threshold 1.0168847143650055 2019-11-14 15:09:54.360: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:09:54.360: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:09:54.555: INFO @decay_lr : LR updated to `0.00079407555` 2019-11-14 15:09:54.556: INFO @log_profile : T train: 55.361753 2019-11-14 15:09:54.556: INFO @log_profile : T valid: 1.826479 2019-11-14 15:09:54.556: INFO @log_profile : T read data: 55.965243 2019-11-14 15:09:54.556: INFO @log_profile : T hooks: 163.794888 2019-11-14 15:09:54.556: INFO @main_loop : Epoch 46 done 2019-11-14 15:09:54.556: INFO @main_loop : Training epoch 47 2019-11-14 15:11:56.964: INFO @log_variables: train loss nanmean: 0.085174 2019-11-14 15:11:56.964: INFO @log_variables: train positive_distance nanmean: 0.577902 2019-11-14 15:11:56.964: INFO @log_variables: train negative_distance nanmean: 1.419064 2019-11-14 15:11:56.964: INFO @log_variables: valid loss nanmean: 0.288196 2019-11-14 15:11:56.964: INFO @log_variables: valid positive_distance nanmean: 0.639350 2019-11-14 15:11:56.964: INFO @log_variables: valid negative_distance nanmean: 1.394404 2019-11-14 15:11:56.964: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:14:18.174: INFO @metrics_hook: train matching accuracy: 0.9936161747685185, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-14 15:14:19.353: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:14:19.603: INFO @evaluate_embedding: best threshold 1.0168768465518951 2019-11-14 15:14:19.710: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:14:19.711: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:14:20.029: INFO @decay_lr : LR updated to `0.00079010514` 2019-11-14 15:14:20.031: INFO @log_profile : T train: 46.039089 2019-11-14 15:14:20.031: INFO @log_profile : T valid: 1.362597 2019-11-14 15:14:20.031: INFO @log_profile : T read data: 68.854566 2019-11-14 15:14:20.031: INFO @log_profile : T hooks: 149.142919 2019-11-14 15:14:20.031: INFO @main_loop : Epoch 47 done 2019-11-14 15:14:20.031: INFO @main_loop : Training epoch 48 2019-11-14 15:16:25.889: INFO @log_variables: train loss nanmean: 0.085331 2019-11-14 15:16:25.889: INFO @log_variables: train positive_distance nanmean: 0.576288 2019-11-14 15:16:25.889: INFO @log_variables: train negative_distance nanmean: 1.419053 2019-11-14 15:16:25.889: INFO @log_variables: valid loss nanmean: 0.278487 2019-11-14 15:16:25.889: INFO @log_variables: valid positive_distance nanmean: 0.643869 2019-11-14 15:16:25.890: INFO @log_variables: valid negative_distance nanmean: 1.395886 2019-11-14 15:16:25.890: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:18:58.212: INFO @metrics_hook: train matching accuracy: 0.9929108796296297, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-14 15:18:59.890: INFO @metrics_hook: valid matching accuracy: 0.985816359176709, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:19:00.248: INFO @evaluate_embedding: best threshold 1.0198772549629214 2019-11-14 15:19:00.400: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:19:00.401: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:19:00.708: INFO @decay_lr : LR updated to `0.0007861546` 2019-11-14 15:19:00.710: INFO @log_profile : T train: 48.126492 2019-11-14 15:19:00.712: INFO @log_profile : T valid: 1.717859 2019-11-14 15:19:00.712: INFO @log_profile : T read data: 69.080255 2019-11-14 15:19:00.712: INFO @log_profile : T hooks: 161.674930 2019-11-14 15:19:00.712: INFO @main_loop : Epoch 48 done 2019-11-14 15:19:00.712: INFO @main_loop : Training epoch 49 2019-11-14 15:21:08.350: INFO @log_variables: train loss nanmean: 0.085252 2019-11-14 15:21:08.350: INFO @log_variables: train positive_distance nanmean: 0.577732 2019-11-14 15:21:08.350: INFO @log_variables: train negative_distance nanmean: 1.419067 2019-11-14 15:21:08.350: INFO @log_variables: valid loss nanmean: 0.280195 2019-11-14 15:21:08.350: INFO @log_variables: valid positive_distance nanmean: 0.640617 2019-11-14 15:21:08.350: INFO @log_variables: valid negative_distance nanmean: 1.393144 2019-11-14 15:21:08.350: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:23:44.484: INFO @metrics_hook: train matching accuracy: 0.9935528790509259, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-14 15:23:46.018: INFO @metrics_hook: valid matching accuracy: 0.9860296470086382, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:23:46.350: INFO @evaluate_embedding: best threshold 1.0168804228305817 2019-11-14 15:23:46.452: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:23:46.452: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:23:46.717: INFO @decay_lr : LR updated to `0.0007822238` 2019-11-14 15:23:46.719: INFO @log_profile : T train: 47.017402 2019-11-14 15:23:46.719: INFO @log_profile : T valid: 1.431465 2019-11-14 15:23:46.719: INFO @log_profile : T read data: 72.504106 2019-11-14 15:23:46.719: INFO @log_profile : T hooks: 164.979381 2019-11-14 15:23:46.719: INFO @main_loop : Epoch 49 done 2019-11-14 15:23:46.719: INFO @main_loop : Training epoch 50 2019-11-14 15:25:50.046: INFO @log_variables: train loss nanmean: 0.082676 2019-11-14 15:25:50.047: INFO @log_variables: train positive_distance nanmean: 0.575850 2019-11-14 15:25:50.047: INFO @log_variables: train negative_distance nanmean: 1.419057 2019-11-14 15:25:50.047: INFO @log_variables: valid loss nanmean: 0.282585 2019-11-14 15:25:50.047: INFO @log_variables: valid positive_distance nanmean: 0.645716 2019-11-14 15:25:50.047: INFO @log_variables: valid negative_distance nanmean: 1.395483 2019-11-14 15:25:50.047: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:28:30.553: INFO @metrics_hook: train matching accuracy: 0.9935618048648159, N=110590, DB_SIZE=110592, N_IDS=7311 2019-11-14 15:28:32.019: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:28:32.361: INFO @evaluate_embedding: best threshold 1.0205999314785004 2019-11-14 15:28:32.552: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:28:32.552: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:28:32.920: INFO @decay_lr : LR updated to `0.0007783127` 2019-11-14 15:28:32.922: INFO @log_profile : T train: 46.754512 2019-11-14 15:28:32.923: INFO @log_profile : T valid: 1.428082 2019-11-14 15:28:32.923: INFO @log_profile : T read data: 68.505364 2019-11-14 15:28:32.923: INFO @log_profile : T hooks: 169.437296 2019-11-14 15:28:32.923: INFO @main_loop : Epoch 50 done 2019-11-14 15:28:32.923: INFO @main_loop : Training epoch 51 2019-11-14 15:30:47.619: INFO @log_variables: train loss nanmean: 0.083403 2019-11-14 15:30:47.619: INFO @log_variables: train positive_distance nanmean: 0.575892 2019-11-14 15:30:47.620: INFO @log_variables: train negative_distance nanmean: 1.419073 2019-11-14 15:30:47.620: INFO @log_variables: valid loss nanmean: 0.281789 2019-11-14 15:30:47.620: INFO @log_variables: valid positive_distance nanmean: 0.643519 2019-11-14 15:30:47.620: INFO @log_variables: valid negative_distance nanmean: 1.394145 2019-11-14 15:30:47.620: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:33:24.489: INFO @metrics_hook: train matching accuracy: 0.9933720341435185, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-14 15:33:25.829: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:33:26.163: INFO @evaluate_embedding: best threshold 1.0188321471214294 2019-11-14 15:33:26.356: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:33:26.357: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:33:26.741: INFO @decay_lr : LR updated to `0.0007744211` 2019-11-14 15:33:26.743: INFO @log_profile : T train: 47.010895 2019-11-14 15:33:26.743: INFO @log_profile : T valid: 1.455512 2019-11-14 15:33:26.743: INFO @log_profile : T read data: 79.250024 2019-11-14 15:33:26.743: INFO @log_profile : T hooks: 166.024518 2019-11-14 15:33:26.743: INFO @main_loop : Epoch 51 done 2019-11-14 15:33:26.743: INFO @main_loop : Training epoch 52 2019-11-14 15:35:42.791: INFO @log_variables: train loss nanmean: 0.083767 2019-11-14 15:35:42.791: INFO @log_variables: train positive_distance nanmean: 0.577094 2019-11-14 15:35:42.791: INFO @log_variables: train negative_distance nanmean: 1.419056 2019-11-14 15:35:42.791: INFO @log_variables: valid loss nanmean: 0.297459 2019-11-14 15:35:42.791: INFO @log_variables: valid positive_distance nanmean: 0.642358 2019-11-14 15:35:42.791: INFO @log_variables: valid negative_distance nanmean: 1.392164 2019-11-14 15:35:42.791: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:38:17.417: INFO @metrics_hook: train matching accuracy: 0.9929108155274842, N=110591, DB_SIZE=110592, N_IDS=7314 2019-11-14 15:38:18.886: INFO @metrics_hook: valid matching accuracy: 0.9856030713447798, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:38:19.107: INFO @evaluate_embedding: best threshold 1.0172605514526367 2019-11-14 15:38:19.248: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:38:19.248: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:38:19.501: INFO @decay_lr : LR updated to `0.000770549` 2019-11-14 15:38:19.503: INFO @log_profile : T train: 49.197871 2019-11-14 15:38:19.503: INFO @log_profile : T valid: 1.607294 2019-11-14 15:38:19.503: INFO @log_profile : T read data: 78.322643 2019-11-14 15:38:19.503: INFO @log_profile : T hooks: 163.542423 2019-11-14 15:38:19.503: INFO @main_loop : Epoch 52 done 2019-11-14 15:38:19.503: INFO @main_loop : Training epoch 53 2019-11-14 15:40:34.031: INFO @log_variables: train loss nanmean: 0.081271 2019-11-14 15:40:34.031: INFO @log_variables: train positive_distance nanmean: 0.576093 2019-11-14 15:40:34.031: INFO @log_variables: train negative_distance nanmean: 1.419079 2019-11-14 15:40:34.031: INFO @log_variables: valid loss nanmean: 0.284373 2019-11-14 15:40:34.031: INFO @log_variables: valid positive_distance nanmean: 0.643397 2019-11-14 15:40:34.031: INFO @log_variables: valid negative_distance nanmean: 1.393222 2019-11-14 15:40:34.032: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:43:24.506: INFO @metrics_hook: train matching accuracy: 0.9927570959662179, N=110591, DB_SIZE=110592, N_IDS=7316 2019-11-14 15:43:26.241: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:43:26.453: INFO @evaluate_embedding: best threshold 1.018309473991394 2019-11-14 15:43:26.578: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:43:26.578: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:43:26.817: INFO @decay_lr : LR updated to `0.00076669623` 2019-11-14 15:43:26.819: INFO @log_profile : T train: 47.961599 2019-11-14 15:43:26.819: INFO @log_profile : T valid: 1.485953 2019-11-14 15:43:26.819: INFO @log_profile : T read data: 78.094773 2019-11-14 15:43:26.819: INFO @log_profile : T hooks: 179.690759 2019-11-14 15:43:26.819: INFO @main_loop : Epoch 53 done 2019-11-14 15:43:26.819: INFO @main_loop : Training epoch 54 2019-11-14 15:45:36.221: INFO @log_variables: train loss nanmean: 0.080482 2019-11-14 15:45:36.221: INFO @log_variables: train positive_distance nanmean: 0.576015 2019-11-14 15:45:36.221: INFO @log_variables: train negative_distance nanmean: 1.419061 2019-11-14 15:45:36.221: INFO @log_variables: valid loss nanmean: 0.277034 2019-11-14 15:45:36.222: INFO @log_variables: valid positive_distance nanmean: 0.643749 2019-11-14 15:45:36.222: INFO @log_variables: valid negative_distance nanmean: 1.394476 2019-11-14 15:45:36.222: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:48:17.520: INFO @metrics_hook: train matching accuracy: 0.9929379425088841, N=110591, DB_SIZE=110592, N_IDS=7316 2019-11-14 15:48:19.124: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:48:19.327: INFO @evaluate_embedding: best threshold 1.0191128253936765 2019-11-14 15:48:19.440: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:48:19.440: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:48:19.708: INFO @decay_lr : LR updated to `0.00076286274` 2019-11-14 15:48:19.710: INFO @log_profile : T train: 46.595842 2019-11-14 15:48:19.710: INFO @log_profile : T valid: 1.450421 2019-11-14 15:48:19.710: INFO @log_profile : T read data: 74.587367 2019-11-14 15:48:19.711: INFO @log_profile : T hooks: 170.173567 2019-11-14 15:48:19.711: INFO @main_loop : Epoch 54 done 2019-11-14 15:48:19.711: INFO @main_loop : Training epoch 55 2019-11-14 15:50:27.167: INFO @log_variables: train loss nanmean: 0.079356 2019-11-14 15:50:27.168: INFO @log_variables: train positive_distance nanmean: 0.574330 2019-11-14 15:50:27.168: INFO @log_variables: train negative_distance nanmean: 1.419093 2019-11-14 15:50:27.168: INFO @log_variables: valid loss nanmean: 0.279057 2019-11-14 15:50:27.168: INFO @log_variables: valid positive_distance nanmean: 0.641983 2019-11-14 15:50:27.168: INFO @log_variables: valid negative_distance nanmean: 1.394751 2019-11-14 15:50:27.168: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:53:03.676: INFO @metrics_hook: train matching accuracy: 0.9929832175925926, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-14 15:53:05.068: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:53:05.791: INFO @evaluate_embedding: best threshold 1.0183668732643127 2019-11-14 15:53:05.876: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:53:05.876: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:53:06.200: INFO @decay_lr : LR updated to `0.00075904845` 2019-11-14 15:53:06.202: INFO @log_profile : T train: 48.317927 2019-11-14 15:53:06.202: INFO @log_profile : T valid: 1.537933 2019-11-14 15:53:06.202: INFO @log_profile : T read data: 71.192807 2019-11-14 15:53:06.202: INFO @log_profile : T hooks: 165.368461 2019-11-14 15:53:06.202: INFO @main_loop : Epoch 55 done 2019-11-14 15:53:06.202: INFO @main_loop : Training epoch 56 2019-11-14 15:55:26.789: INFO @log_variables: train loss nanmean: 0.079882 2019-11-14 15:55:26.789: INFO @log_variables: train positive_distance nanmean: 0.574912 2019-11-14 15:55:26.789: INFO @log_variables: train negative_distance nanmean: 1.419066 2019-11-14 15:55:26.789: INFO @log_variables: valid loss nanmean: 0.285733 2019-11-14 15:55:26.789: INFO @log_variables: valid positive_distance nanmean: 0.649366 2019-11-14 15:55:26.789: INFO @log_variables: valid negative_distance nanmean: 1.395983 2019-11-14 15:55:26.789: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 15:58:02.768: INFO @metrics_hook: train matching accuracy: 0.9929017732003509, N=110591, DB_SIZE=110592, N_IDS=7317 2019-11-14 15:58:04.076: INFO @metrics_hook: valid matching accuracy: 0.9859230030926736, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 15:58:04.271: INFO @evaluate_embedding: best threshold 1.0226747989654539 2019-11-14 15:58:04.384: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 15:58:04.384: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 15:58:04.601: INFO @decay_lr : LR updated to `0.0007552532` 2019-11-14 15:58:04.603: INFO @log_profile : T train: 46.964864 2019-11-14 15:58:04.603: INFO @log_profile : T valid: 1.426095 2019-11-14 15:58:04.603: INFO @log_profile : T read data: 85.734826 2019-11-14 15:58:04.603: INFO @log_profile : T hooks: 164.196995 2019-11-14 15:58:04.603: INFO @main_loop : Epoch 56 done 2019-11-14 15:58:04.603: INFO @main_loop : Training epoch 57 2019-11-14 16:00:18.097: INFO @log_variables: train loss nanmean: 0.079297 2019-11-14 16:00:18.097: INFO @log_variables: train positive_distance nanmean: 0.574659 2019-11-14 16:00:18.097: INFO @log_variables: train negative_distance nanmean: 1.419085 2019-11-14 16:00:18.097: INFO @log_variables: valid loss nanmean: 0.281270 2019-11-14 16:00:18.097: INFO @log_variables: valid positive_distance nanmean: 0.648813 2019-11-14 16:00:18.097: INFO @log_variables: valid negative_distance nanmean: 1.396910 2019-11-14 16:00:18.097: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:02:48.383: INFO @metrics_hook: train matching accuracy: 0.9927209924768519, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-14 16:02:49.663: INFO @metrics_hook: valid matching accuracy: 0.9857097152607444, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:02:49.892: INFO @evaluate_embedding: best threshold 1.0228615999221802 2019-11-14 16:02:49.983: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:02:49.983: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:02:50.192: INFO @decay_lr : LR updated to `0.0007514769` 2019-11-14 16:02:50.194: INFO @log_profile : T train: 48.063788 2019-11-14 16:02:50.194: INFO @log_profile : T valid: 1.594604 2019-11-14 16:02:50.194: INFO @log_profile : T read data: 77.435999 2019-11-14 16:02:50.194: INFO @log_profile : T hooks: 158.406300 2019-11-14 16:02:50.194: INFO @main_loop : Epoch 57 done 2019-11-14 16:02:50.194: INFO @main_loop : Training epoch 58 2019-11-14 16:05:10.779: INFO @log_variables: train loss nanmean: 0.077106 2019-11-14 16:05:10.779: INFO @log_variables: train positive_distance nanmean: 0.574060 2019-11-14 16:05:10.780: INFO @log_variables: train negative_distance nanmean: 1.419089 2019-11-14 16:05:10.780: INFO @log_variables: valid loss nanmean: 0.282427 2019-11-14 16:05:10.780: INFO @log_variables: valid positive_distance nanmean: 0.642760 2019-11-14 16:05:10.780: INFO @log_variables: valid negative_distance nanmean: 1.395223 2019-11-14 16:05:10.780: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:07:47.984: INFO @metrics_hook: train matching accuracy: 0.9930917245370371, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-14 16:07:49.240: INFO @metrics_hook: valid matching accuracy: 0.985816359176709, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:07:49.462: INFO @evaluate_embedding: best threshold 1.018991142511368 2019-11-14 16:07:49.568: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:07:49.569: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:07:49.817: INFO @decay_lr : LR updated to `0.00074771955` 2019-11-14 16:07:49.819: INFO @log_profile : T train: 48.011553 2019-11-14 16:07:49.819: INFO @log_profile : T valid: 1.396676 2019-11-14 16:07:49.819: INFO @log_profile : T read data: 85.014649 2019-11-14 16:07:49.819: INFO @log_profile : T hooks: 165.125188 2019-11-14 16:07:49.819: INFO @main_loop : Epoch 58 done 2019-11-14 16:07:49.819: INFO @main_loop : Training epoch 59 2019-11-14 16:10:08.982: INFO @log_variables: train loss nanmean: 0.076745 2019-11-14 16:10:08.983: INFO @log_variables: train positive_distance nanmean: 0.574697 2019-11-14 16:10:08.983: INFO @log_variables: train negative_distance nanmean: 1.419061 2019-11-14 16:10:08.983: INFO @log_variables: valid loss nanmean: 0.279491 2019-11-14 16:10:08.983: INFO @log_variables: valid positive_distance nanmean: 0.646752 2019-11-14 16:10:08.983: INFO @log_variables: valid negative_distance nanmean: 1.395610 2019-11-14 16:10:08.984: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:12:45.088: INFO @metrics_hook: train matching accuracy: 0.9928927951388888, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-14 16:12:46.648: INFO @metrics_hook: valid matching accuracy: 0.9857097152607444, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:12:46.954: INFO @evaluate_embedding: best threshold 1.0211807787418365 2019-11-14 16:12:47.071: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:12:47.071: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:12:47.321: INFO @decay_lr : LR updated to `0.0007439809` 2019-11-14 16:12:47.322: INFO @log_profile : T train: 46.989676 2019-11-14 16:12:47.323: INFO @log_profile : T valid: 1.438397 2019-11-14 16:12:47.323: INFO @log_profile : T read data: 84.019279 2019-11-14 16:12:47.323: INFO @log_profile : T hooks: 164.971146 2019-11-14 16:12:47.323: INFO @main_loop : Epoch 59 done 2019-11-14 16:12:47.323: INFO @main_loop : Training epoch 60 2019-11-14 16:15:11.904: INFO @log_variables: train loss nanmean: 0.076804 2019-11-14 16:15:11.905: INFO @log_variables: train positive_distance nanmean: 0.574385 2019-11-14 16:15:11.905: INFO @log_variables: train negative_distance nanmean: 1.419092 2019-11-14 16:15:11.905: INFO @log_variables: valid loss nanmean: 0.277199 2019-11-14 16:15:11.905: INFO @log_variables: valid positive_distance nanmean: 0.649906 2019-11-14 16:15:11.905: INFO @log_variables: valid negative_distance nanmean: 1.395983 2019-11-14 16:15:11.906: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:17:48.894: INFO @metrics_hook: train matching accuracy: 0.9933358049027498, N=110591, DB_SIZE=110592, N_IDS=7308 2019-11-14 16:17:50.380: INFO @metrics_hook: valid matching accuracy: 0.985816359176709, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:17:50.732: INFO @evaluate_embedding: best threshold 1.02294459939003 2019-11-14 16:17:50.864: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:17:50.864: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:17:51.149: INFO @decay_lr : LR updated to `0.00074026105` 2019-11-14 16:17:51.152: INFO @log_profile : T train: 48.723080 2019-11-14 16:17:51.152: INFO @log_profile : T valid: 1.580444 2019-11-14 16:17:51.152: INFO @log_profile : T read data: 87.835876 2019-11-14 16:17:51.153: INFO @log_profile : T hooks: 165.614257 2019-11-14 16:17:51.153: INFO @main_loop : Epoch 60 done 2019-11-14 16:17:51.153: INFO @main_loop : Training epoch 61 2019-11-14 16:20:20.244: INFO @log_variables: train loss nanmean: 0.075912 2019-11-14 16:20:20.244: INFO @log_variables: train positive_distance nanmean: 0.574705 2019-11-14 16:20:20.245: INFO @log_variables: train negative_distance nanmean: 1.419112 2019-11-14 16:20:20.245: INFO @log_variables: valid loss nanmean: 0.276050 2019-11-14 16:20:20.245: INFO @log_variables: valid positive_distance nanmean: 0.648409 2019-11-14 16:20:20.245: INFO @log_variables: valid negative_distance nanmean: 1.396845 2019-11-14 16:20:20.245: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:22:59.059: INFO @metrics_hook: train matching accuracy: 0.9926034432870371, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-14 16:23:00.517: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:23:01.005: INFO @evaluate_embedding: best threshold 1.0226271450519564 2019-11-14 16:23:01.303: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:23:01.303: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:23:01.605: INFO @decay_lr : LR updated to `0.00073655974` 2019-11-14 16:23:01.608: INFO @log_profile : T train: 47.294399 2019-11-14 16:23:01.609: INFO @log_profile : T valid: 1.401650 2019-11-14 16:23:01.609: INFO @log_profile : T read data: 94.072418 2019-11-14 16:23:01.609: INFO @log_profile : T hooks: 167.612236 2019-11-14 16:23:01.609: INFO @main_loop : Epoch 61 done 2019-11-14 16:23:01.609: INFO @main_loop : Training epoch 62 2019-11-14 16:25:30.480: INFO @log_variables: train loss nanmean: 0.075284 2019-11-14 16:25:30.481: INFO @log_variables: train positive_distance nanmean: 0.573954 2019-11-14 16:25:30.481: INFO @log_variables: train negative_distance nanmean: 1.419102 2019-11-14 16:25:30.481: INFO @log_variables: valid loss nanmean: 0.280229 2019-11-14 16:25:30.481: INFO @log_variables: valid positive_distance nanmean: 0.649970 2019-11-14 16:25:30.481: INFO @log_variables: valid negative_distance nanmean: 1.396504 2019-11-14 16:25:30.481: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:28:12.889: INFO @metrics_hook: train matching accuracy: 0.9929922598379629, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-14 16:28:14.534: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:28:14.915: INFO @evaluate_embedding: best threshold 1.0232371389865877 2019-11-14 16:28:15.098: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:28:15.098: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:28:15.416: INFO @decay_lr : LR updated to `0.00073287694` 2019-11-14 16:28:15.418: INFO @log_profile : T train: 49.221304 2019-11-14 16:28:15.418: INFO @log_profile : T valid: 1.566003 2019-11-14 16:28:15.418: INFO @log_profile : T read data: 91.650485 2019-11-14 16:28:15.418: INFO @log_profile : T hooks: 171.292084 2019-11-14 16:28:15.418: INFO @main_loop : Epoch 62 done 2019-11-14 16:28:15.418: INFO @main_loop : Training epoch 63 2019-11-14 16:30:44.048: INFO @log_variables: train loss nanmean: 0.074610 2019-11-14 16:30:44.048: INFO @log_variables: train positive_distance nanmean: 0.573631 2019-11-14 16:30:44.048: INFO @log_variables: train negative_distance nanmean: 1.419104 2019-11-14 16:30:44.048: INFO @log_variables: valid loss nanmean: 0.278529 2019-11-14 16:30:44.048: INFO @log_variables: valid positive_distance nanmean: 0.649615 2019-11-14 16:30:44.048: INFO @log_variables: valid negative_distance nanmean: 1.398049 2019-11-14 16:30:44.048: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:33:27.911: INFO @metrics_hook: train matching accuracy: 0.9924948006148838, N=110590, DB_SIZE=110592, N_IDS=7304 2019-11-14 16:33:29.288: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:33:29.619: INFO @evaluate_embedding: best threshold 1.023832142353058 2019-11-14 16:33:29.748: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:33:29.749: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:33:30.039: INFO @decay_lr : LR updated to `0.00072921254` 2019-11-14 16:33:30.040: INFO @log_profile : T train: 46.739609 2019-11-14 16:33:30.041: INFO @log_profile : T valid: 1.463159 2019-11-14 16:33:30.041: INFO @log_profile : T read data: 93.833887 2019-11-14 16:33:30.041: INFO @log_profile : T hooks: 172.513090 2019-11-14 16:33:30.041: INFO @main_loop : Epoch 63 done 2019-11-14 16:33:30.041: INFO @main_loop : Training epoch 64 2019-11-14 16:36:00.004: INFO @log_variables: train loss nanmean: 0.074440 2019-11-14 16:36:00.004: INFO @log_variables: train positive_distance nanmean: 0.573457 2019-11-14 16:36:00.005: INFO @log_variables: train negative_distance nanmean: 1.419092 2019-11-14 16:36:00.005: INFO @log_variables: valid loss nanmean: 0.273897 2019-11-14 16:36:00.005: INFO @log_variables: valid positive_distance nanmean: 0.649440 2019-11-14 16:36:00.005: INFO @log_variables: valid negative_distance nanmean: 1.396965 2019-11-14 16:36:00.005: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:38:42.338: INFO @metrics_hook: train matching accuracy: 0.9925943340778183, N=110591, DB_SIZE=110592, N_IDS=7316 2019-11-14 16:38:43.971: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:38:44.246: INFO @evaluate_embedding: best threshold 1.023202806711197 2019-11-14 16:38:44.335: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:38:44.335: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:38:44.554: INFO @decay_lr : LR updated to `0.00072556647` 2019-11-14 16:38:44.556: INFO @log_profile : T train: 46.569673 2019-11-14 16:38:44.556: INFO @log_profile : T valid: 1.431607 2019-11-14 16:38:44.556: INFO @log_profile : T read data: 95.472200 2019-11-14 16:38:44.556: INFO @log_profile : T hooks: 170.969840 2019-11-14 16:38:44.556: INFO @main_loop : Epoch 64 done 2019-11-14 16:38:44.556: INFO @main_loop : Training epoch 65 2019-11-14 16:41:12.704: INFO @log_variables: train loss nanmean: 0.073222 2019-11-14 16:41:12.705: INFO @log_variables: train positive_distance nanmean: 0.572625 2019-11-14 16:41:12.705: INFO @log_variables: train negative_distance nanmean: 1.419122 2019-11-14 16:41:12.705: INFO @log_variables: valid loss nanmean: 0.277373 2019-11-14 16:41:12.705: INFO @log_variables: valid positive_distance nanmean: 0.645311 2019-11-14 16:41:12.705: INFO @log_variables: valid negative_distance nanmean: 1.395388 2019-11-14 16:41:12.705: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:43:56.262: INFO @metrics_hook: train matching accuracy: 0.9931911892361112, N=110592, DB_SIZE=110592, N_IDS=7322 2019-11-14 16:43:57.618: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:43:57.823: INFO @evaluate_embedding: best threshold 1.0203493535518648 2019-11-14 16:43:57.935: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:43:57.935: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:43:58.207: INFO @decay_lr : LR updated to `0.0007219386` 2019-11-14 16:43:58.209: INFO @log_profile : T train: 46.821540 2019-11-14 16:43:58.209: INFO @log_profile : T valid: 1.422035 2019-11-14 16:43:58.210: INFO @log_profile : T read data: 93.489824 2019-11-14 16:43:58.210: INFO @log_profile : T hooks: 171.842083 2019-11-14 16:43:58.210: INFO @main_loop : Epoch 65 done 2019-11-14 16:43:58.210: INFO @main_loop : Training epoch 66 2019-11-14 16:46:28.028: INFO @log_variables: train loss nanmean: 0.073425 2019-11-14 16:46:28.028: INFO @log_variables: train positive_distance nanmean: 0.572531 2019-11-14 16:46:28.028: INFO @log_variables: train negative_distance nanmean: 1.419114 2019-11-14 16:46:28.028: INFO @log_variables: valid loss nanmean: 0.277206 2019-11-14 16:46:28.028: INFO @log_variables: valid positive_distance nanmean: 0.645490 2019-11-14 16:46:28.028: INFO @log_variables: valid negative_distance nanmean: 1.396294 2019-11-14 16:46:28.028: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:49:03.711: INFO @metrics_hook: train matching accuracy: 0.9932454427083334, N=110592, DB_SIZE=110592, N_IDS=7304 2019-11-14 16:49:04.996: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:49:05.338: INFO @evaluate_embedding: best threshold 1.0208920538425443 2019-11-14 16:49:05.450: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:49:05.450: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:49:05.678: INFO @decay_lr : LR updated to `0.0007183289` 2019-11-14 16:49:06.007: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 16:49:06.034: INFO @log_profile : T train: 46.900055 2019-11-14 16:49:06.034: INFO @log_profile : T valid: 1.411890 2019-11-14 16:49:06.034: INFO @log_profile : T read data: 95.235307 2019-11-14 16:49:06.034: INFO @log_profile : T hooks: 164.187191 2019-11-14 16:49:06.034: INFO @main_loop : Epoch 66 done 2019-11-14 16:49:06.034: INFO @main_loop : Training epoch 67 2019-11-14 16:51:46.417: INFO @log_variables: train loss nanmean: 0.071835 2019-11-14 16:51:46.418: INFO @log_variables: train positive_distance nanmean: 0.572883 2019-11-14 16:51:46.418: INFO @log_variables: train negative_distance nanmean: 1.419118 2019-11-14 16:51:46.418: INFO @log_variables: valid loss nanmean: 0.278836 2019-11-14 16:51:46.418: INFO @log_variables: valid positive_distance nanmean: 0.652302 2019-11-14 16:51:46.418: INFO @log_variables: valid negative_distance nanmean: 1.396685 2019-11-14 16:51:46.418: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:54:23.101: INFO @metrics_hook: train matching accuracy: 0.9930374710648148, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-14 16:54:24.280: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:54:24.490: INFO @evaluate_embedding: best threshold 1.0244935750961304 2019-11-14 16:54:24.577: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:54:24.577: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:54:24.792: INFO @decay_lr : LR updated to `0.0007147373` 2019-11-14 16:54:24.795: INFO @log_profile : T train: 47.534233 2019-11-14 16:54:24.795: INFO @log_profile : T valid: 1.437513 2019-11-14 16:54:24.795: INFO @log_profile : T read data: 104.922329 2019-11-14 16:54:24.795: INFO @log_profile : T hooks: 164.790969 2019-11-14 16:54:24.796: INFO @main_loop : Epoch 67 done 2019-11-14 16:54:24.796: INFO @main_loop : Training epoch 68 2019-11-14 16:57:01.592: INFO @log_variables: train loss nanmean: 0.072304 2019-11-14 16:57:01.592: INFO @log_variables: train positive_distance nanmean: 0.573541 2019-11-14 16:57:01.592: INFO @log_variables: train negative_distance nanmean: 1.419102 2019-11-14 16:57:01.592: INFO @log_variables: valid loss nanmean: 0.275039 2019-11-14 16:57:01.592: INFO @log_variables: valid positive_distance nanmean: 0.651055 2019-11-14 16:57:01.592: INFO @log_variables: valid negative_distance nanmean: 1.394822 2019-11-14 16:57:01.592: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 16:59:41.348: INFO @metrics_hook: train matching accuracy: 0.9935257523148148, N=110592, DB_SIZE=110592, N_IDS=7324 2019-11-14 16:59:43.279: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 16:59:43.487: INFO @evaluate_embedding: best threshold 1.0229385793209076 2019-11-14 16:59:43.628: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 16:59:43.628: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 16:59:43.874: INFO @decay_lr : LR updated to `0.0007111636` 2019-11-14 16:59:43.875: INFO @log_profile : T train: 47.960160 2019-11-14 16:59:43.875: INFO @log_profile : T valid: 1.427937 2019-11-14 16:59:43.876: INFO @log_profile : T read data: 100.887917 2019-11-14 16:59:43.876: INFO @log_profile : T hooks: 168.729401 2019-11-14 16:59:43.876: INFO @main_loop : Epoch 68 done 2019-11-14 16:59:43.876: INFO @main_loop : Training epoch 69 2019-11-14 17:02:22.951: INFO @log_variables: train loss nanmean: 0.071983 2019-11-14 17:02:22.951: INFO @log_variables: train positive_distance nanmean: 0.573445 2019-11-14 17:02:22.951: INFO @log_variables: train negative_distance nanmean: 1.419118 2019-11-14 17:02:22.951: INFO @log_variables: valid loss nanmean: 0.284959 2019-11-14 17:02:22.952: INFO @log_variables: valid positive_distance nanmean: 0.648831 2019-11-14 17:02:22.952: INFO @log_variables: valid negative_distance nanmean: 1.395771 2019-11-14 17:02:22.952: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:05:03.337: INFO @metrics_hook: train matching accuracy: 0.9925130208333334, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-14 17:05:04.575: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:05:04.850: INFO @evaluate_embedding: best threshold 1.0223005414009096 2019-11-14 17:05:04.982: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:05:04.983: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:05:05.266: INFO @decay_lr : LR updated to `0.00070760783` 2019-11-14 17:05:05.268: INFO @log_profile : T train: 47.369585 2019-11-14 17:05:05.268: INFO @log_profile : T valid: 1.403728 2019-11-14 17:05:05.268: INFO @log_profile : T read data: 104.183212 2019-11-14 17:05:05.268: INFO @log_profile : T hooks: 168.352472 2019-11-14 17:05:05.268: INFO @main_loop : Epoch 69 done 2019-11-14 17:05:05.268: INFO @main_loop : Training epoch 70 2019-11-14 17:07:43.041: INFO @log_variables: train loss nanmean: 0.071164 2019-11-14 17:07:43.042: INFO @log_variables: train positive_distance nanmean: 0.571673 2019-11-14 17:07:43.042: INFO @log_variables: train negative_distance nanmean: 1.419116 2019-11-14 17:07:43.042: INFO @log_variables: valid loss nanmean: 0.278034 2019-11-14 17:07:43.042: INFO @log_variables: valid positive_distance nanmean: 0.658454 2019-11-14 17:07:43.042: INFO @log_variables: valid negative_distance nanmean: 1.396692 2019-11-14 17:07:43.043: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:10:24.591: INFO @metrics_hook: train matching accuracy: 0.9926124855324074, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-14 17:10:26.152: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:10:26.391: INFO @evaluate_embedding: best threshold 1.0275726914405823 2019-11-14 17:10:26.483: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:10:26.483: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:10:26.718: INFO @decay_lr : LR updated to `0.0007040698` 2019-11-14 17:10:26.720: INFO @log_profile : T train: 47.038312 2019-11-14 17:10:26.720: INFO @log_profile : T valid: 1.421488 2019-11-14 17:10:26.720: INFO @log_profile : T read data: 102.559934 2019-11-14 17:10:26.720: INFO @log_profile : T hooks: 170.343953 2019-11-14 17:10:26.720: INFO @main_loop : Epoch 70 done 2019-11-14 17:10:26.721: INFO @main_loop : Training epoch 71 2019-11-14 17:13:08.350: INFO @log_variables: train loss nanmean: 0.069790 2019-11-14 17:13:08.350: INFO @log_variables: train positive_distance nanmean: 0.571909 2019-11-14 17:13:08.350: INFO @log_variables: train negative_distance nanmean: 1.419116 2019-11-14 17:13:08.350: INFO @log_variables: valid loss nanmean: 0.276582 2019-11-14 17:13:08.350: INFO @log_variables: valid positive_distance nanmean: 0.649291 2019-11-14 17:13:08.350: INFO @log_variables: valid negative_distance nanmean: 1.396538 2019-11-14 17:13:08.350: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:15:54.313: INFO @metrics_hook: train matching accuracy: 0.9927842881944444, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-14 17:15:55.604: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:15:55.826: INFO @evaluate_embedding: best threshold 1.0229144990444181 2019-11-14 17:15:55.911: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:15:55.911: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:15:56.232: INFO @decay_lr : LR updated to `0.00070054946` 2019-11-14 17:15:56.234: INFO @log_profile : T train: 47.154660 2019-11-14 17:15:56.234: INFO @log_profile : T valid: 1.407214 2019-11-14 17:15:56.234: INFO @log_profile : T read data: 106.888152 2019-11-14 17:15:56.234: INFO @log_profile : T hooks: 173.992848 2019-11-14 17:15:56.234: INFO @main_loop : Epoch 71 done 2019-11-14 17:15:56.234: INFO @main_loop : Training epoch 72 2019-11-14 17:18:37.089: INFO @log_variables: train loss nanmean: 0.070040 2019-11-14 17:18:37.089: INFO @log_variables: train positive_distance nanmean: 0.570836 2019-11-14 17:18:37.089: INFO @log_variables: train negative_distance nanmean: 1.419128 2019-11-14 17:18:37.089: INFO @log_variables: valid loss nanmean: 0.282064 2019-11-14 17:18:37.089: INFO @log_variables: valid positive_distance nanmean: 0.650305 2019-11-14 17:18:37.089: INFO @log_variables: valid negative_distance nanmean: 1.396147 2019-11-14 17:18:37.089: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:21:19.413: INFO @metrics_hook: train matching accuracy: 0.9928837528935185, N=110592, DB_SIZE=110592, N_IDS=7307 2019-11-14 17:21:20.879: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:21:21.107: INFO @evaluate_embedding: best threshold 1.0232257843017576 2019-11-14 17:21:21.190: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:21:21.190: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:21:21.465: INFO @decay_lr : LR updated to `0.0006970467` 2019-11-14 17:21:21.466: INFO @log_profile : T train: 47.973974 2019-11-14 17:21:21.467: INFO @log_profile : T valid: 1.411995 2019-11-14 17:21:21.467: INFO @log_profile : T read data: 104.921621 2019-11-14 17:21:21.467: INFO @log_profile : T hooks: 170.845468 2019-11-14 17:21:21.467: INFO @main_loop : Epoch 72 done 2019-11-14 17:21:21.467: INFO @main_loop : Training epoch 73 2019-11-14 17:24:02.994: INFO @log_variables: train loss nanmean: 0.071372 2019-11-14 17:24:02.994: INFO @log_variables: train positive_distance nanmean: 0.572306 2019-11-14 17:24:02.995: INFO @log_variables: train negative_distance nanmean: 1.419144 2019-11-14 17:24:02.995: INFO @log_variables: valid loss nanmean: 0.282704 2019-11-14 17:24:02.995: INFO @log_variables: valid positive_distance nanmean: 0.649118 2019-11-14 17:24:02.995: INFO @log_variables: valid negative_distance nanmean: 1.397117 2019-11-14 17:24:02.995: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:26:40.806: INFO @metrics_hook: train matching accuracy: 0.9929018373842593, N=110592, DB_SIZE=110592, N_IDS=7302 2019-11-14 17:26:42.486: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:26:42.700: INFO @evaluate_embedding: best threshold 1.023117780685425 2019-11-14 17:26:42.797: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:26:42.797: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:26:43.027: INFO @decay_lr : LR updated to `0.00069356145` 2019-11-14 17:26:43.029: INFO @log_profile : T train: 47.424500 2019-11-14 17:26:43.029: INFO @log_profile : T valid: 1.400115 2019-11-14 17:26:43.029: INFO @log_profile : T read data: 106.437479 2019-11-14 17:26:43.029: INFO @log_profile : T hooks: 166.228142 2019-11-14 17:26:43.029: INFO @main_loop : Epoch 73 done 2019-11-14 17:26:43.029: INFO @main_loop : Training epoch 74 2019-11-14 17:29:27.933: INFO @log_variables: train loss nanmean: 0.068627 2019-11-14 17:29:27.933: INFO @log_variables: train positive_distance nanmean: 0.570441 2019-11-14 17:29:27.933: INFO @log_variables: train negative_distance nanmean: 1.419155 2019-11-14 17:29:27.933: INFO @log_variables: valid loss nanmean: 0.275068 2019-11-14 17:29:27.933: INFO @log_variables: valid positive_distance nanmean: 0.652369 2019-11-14 17:29:27.933: INFO @log_variables: valid negative_distance nanmean: 1.396647 2019-11-14 17:29:27.933: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:32:07.993: INFO @metrics_hook: train matching accuracy: 0.992431435314543, N=110589, DB_SIZE=110592, N_IDS=7303 2019-11-14 17:32:09.493: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:32:09.732: INFO @evaluate_embedding: best threshold 1.0245080292224882 2019-11-14 17:32:09.843: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:32:09.843: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:32:10.197: INFO @decay_lr : LR updated to `0.0006900937` 2019-11-14 17:32:10.199: INFO @log_profile : T train: 47.473630 2019-11-14 17:32:10.200: INFO @log_profile : T valid: 1.436195 2019-11-14 17:32:10.200: INFO @log_profile : T read data: 109.099883 2019-11-14 17:32:10.200: INFO @log_profile : T hooks: 169.084828 2019-11-14 17:32:10.200: INFO @main_loop : Epoch 74 done 2019-11-14 17:32:10.200: INFO @main_loop : Training epoch 75 2019-11-14 17:34:58.677: INFO @log_variables: train loss nanmean: 0.069814 2019-11-14 17:34:58.678: INFO @log_variables: train positive_distance nanmean: 0.571412 2019-11-14 17:34:58.678: INFO @log_variables: train negative_distance nanmean: 1.419114 2019-11-14 17:34:58.678: INFO @log_variables: valid loss nanmean: 0.273878 2019-11-14 17:34:58.678: INFO @log_variables: valid positive_distance nanmean: 0.649945 2019-11-14 17:34:58.678: INFO @log_variables: valid negative_distance nanmean: 1.395891 2019-11-14 17:34:58.678: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:37:41.196: INFO @metrics_hook: train matching accuracy: 0.9926667390046297, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-14 17:37:42.542: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:37:42.990: INFO @evaluate_embedding: best threshold 1.0229183435440061 2019-11-14 17:37:43.092: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:37:43.092: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:37:43.379: INFO @decay_lr : LR updated to `0.0006866432` 2019-11-14 17:37:43.381: INFO @log_profile : T train: 48.550791 2019-11-14 17:37:43.381: INFO @log_profile : T valid: 1.574077 2019-11-14 17:37:43.381: INFO @log_profile : T read data: 111.588174 2019-11-14 17:37:43.381: INFO @log_profile : T hooks: 171.398371 2019-11-14 17:37:43.381: INFO @main_loop : Epoch 75 done 2019-11-14 17:37:43.381: INFO @main_loop : Training epoch 76 2019-11-14 17:40:28.537: INFO @log_variables: train loss nanmean: 0.068894 2019-11-14 17:40:28.538: INFO @log_variables: train positive_distance nanmean: 0.571185 2019-11-14 17:40:28.538: INFO @log_variables: train negative_distance nanmean: 1.419142 2019-11-14 17:40:28.538: INFO @log_variables: valid loss nanmean: 0.280988 2019-11-14 17:40:28.538: INFO @log_variables: valid positive_distance nanmean: 0.649025 2019-11-14 17:40:28.538: INFO @log_variables: valid negative_distance nanmean: 1.396801 2019-11-14 17:40:28.538: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:43:11.011: INFO @metrics_hook: train matching accuracy: 0.9931278935185185, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-14 17:43:12.528: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:43:12.695: INFO @evaluate_embedding: best threshold 1.0229130387306211 2019-11-14 17:43:12.810: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:43:12.810: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:43:13.060: INFO @decay_lr : LR updated to `0.00068321` 2019-11-14 17:43:13.062: INFO @log_profile : T train: 49.789480 2019-11-14 17:43:13.063: INFO @log_profile : T valid: 1.392720 2019-11-14 17:43:13.063: INFO @log_profile : T read data: 107.514078 2019-11-14 17:43:13.063: INFO @log_profile : T hooks: 170.911682 2019-11-14 17:43:13.063: INFO @main_loop : Epoch 76 done 2019-11-14 17:43:13.063: INFO @main_loop : Training epoch 77 2019-11-14 17:45:57.237: INFO @log_variables: train loss nanmean: 0.068163 2019-11-14 17:45:57.237: INFO @log_variables: train positive_distance nanmean: 0.571203 2019-11-14 17:45:57.237: INFO @log_variables: train negative_distance nanmean: 1.419168 2019-11-14 17:45:57.237: INFO @log_variables: valid loss nanmean: 0.274112 2019-11-14 17:45:57.237: INFO @log_variables: valid positive_distance nanmean: 0.651246 2019-11-14 17:45:57.237: INFO @log_variables: valid negative_distance nanmean: 1.395682 2019-11-14 17:45:57.238: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:48:42.109: INFO @metrics_hook: train matching accuracy: 0.9933901186342593, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-14 17:48:43.519: INFO @metrics_hook: valid matching accuracy: 0.9860296470086382, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:48:44.569: INFO @evaluate_embedding: best threshold 1.0234643816947935 2019-11-14 17:48:44.656: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:48:44.656: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:48:44.896: INFO @decay_lr : LR updated to `0.00067979394` 2019-11-14 17:48:44.898: INFO @log_profile : T train: 48.057620 2019-11-14 17:48:44.898: INFO @log_profile : T valid: 1.439622 2019-11-14 17:48:44.898: INFO @log_profile : T read data: 108.248603 2019-11-14 17:48:44.898: INFO @log_profile : T hooks: 174.017316 2019-11-14 17:48:44.898: INFO @main_loop : Epoch 77 done 2019-11-14 17:48:44.898: INFO @main_loop : Training epoch 78 2019-11-14 17:51:33.076: INFO @log_variables: train loss nanmean: 0.068395 2019-11-14 17:51:33.077: INFO @log_variables: train positive_distance nanmean: 0.571514 2019-11-14 17:51:33.077: INFO @log_variables: train negative_distance nanmean: 1.419147 2019-11-14 17:51:33.077: INFO @log_variables: valid loss nanmean: 0.285931 2019-11-14 17:51:33.077: INFO @log_variables: valid positive_distance nanmean: 0.650780 2019-11-14 17:51:33.077: INFO @log_variables: valid negative_distance nanmean: 1.394992 2019-11-14 17:51:33.077: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:54:09.806: INFO @metrics_hook: train matching accuracy: 0.9930917245370371, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-14 17:54:11.316: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:54:11.706: INFO @evaluate_embedding: best threshold 1.022885888814926 2019-11-14 17:54:11.845: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:54:11.846: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:54:12.106: INFO @decay_lr : LR updated to `0.00067639496` 2019-11-14 17:54:12.108: INFO @log_profile : T train: 48.288980 2019-11-14 17:54:12.108: INFO @log_profile : T valid: 1.434387 2019-11-14 17:54:12.108: INFO @log_profile : T read data: 112.313201 2019-11-14 17:54:12.108: INFO @log_profile : T hooks: 165.091054 2019-11-14 17:54:12.108: INFO @main_loop : Epoch 78 done 2019-11-14 17:54:12.109: INFO @main_loop : Training epoch 79 2019-11-14 17:56:58.068: INFO @log_variables: train loss nanmean: 0.066627 2019-11-14 17:56:58.068: INFO @log_variables: train positive_distance nanmean: 0.569946 2019-11-14 17:56:58.069: INFO @log_variables: train negative_distance nanmean: 1.419148 2019-11-14 17:56:58.069: INFO @log_variables: valid loss nanmean: 0.280942 2019-11-14 17:56:58.069: INFO @log_variables: valid positive_distance nanmean: 0.647463 2019-11-14 17:56:58.069: INFO @log_variables: valid negative_distance nanmean: 1.396912 2019-11-14 17:56:58.069: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 17:59:39.062: INFO @metrics_hook: train matching accuracy: 0.9929289641203703, N=110592, DB_SIZE=110592, N_IDS=7304 2019-11-14 17:59:40.585: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 17:59:40.882: INFO @evaluate_embedding: best threshold 1.02218759059906 2019-11-14 17:59:40.993: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 17:59:40.993: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 17:59:41.344: INFO @decay_lr : LR updated to `0.000673013` 2019-11-14 17:59:41.767: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-14 17:59:41.792: INFO @log_profile : T train: 47.933975 2019-11-14 17:59:41.792: INFO @log_profile : T valid: 1.461410 2019-11-14 17:59:41.792: INFO @log_profile : T read data: 110.154489 2019-11-14 17:59:41.792: INFO @log_profile : T hooks: 170.045946 2019-11-14 17:59:41.792: INFO @main_loop : Epoch 79 done 2019-11-14 17:59:41.792: INFO @main_loop : Training epoch 80 2019-11-14 18:02:30.258: INFO @log_variables: train loss nanmean: 0.067307 2019-11-14 18:02:30.258: INFO @log_variables: train positive_distance nanmean: 0.570865 2019-11-14 18:02:30.258: INFO @log_variables: train negative_distance nanmean: 1.419151 2019-11-14 18:02:30.258: INFO @log_variables: valid loss nanmean: 0.276645 2019-11-14 18:02:30.258: INFO @log_variables: valid positive_distance nanmean: 0.652410 2019-11-14 18:02:30.258: INFO @log_variables: valid negative_distance nanmean: 1.397072 2019-11-14 18:02:30.259: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:05:13.094: INFO @metrics_hook: train matching accuracy: 0.9932634662856833, N=110591, DB_SIZE=110592, N_IDS=7314 2019-11-14 18:05:14.380: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:05:14.583: INFO @evaluate_embedding: best threshold 1.0247413218021393 2019-11-14 18:05:14.658: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:05:14.658: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:05:14.859: INFO @decay_lr : LR updated to `0.00066964794` 2019-11-14 18:05:14.861: INFO @log_profile : T train: 47.543317 2019-11-14 18:05:14.861: INFO @log_profile : T valid: 1.428770 2019-11-14 18:05:14.861: INFO @log_profile : T read data: 113.236851 2019-11-14 18:05:14.861: INFO @log_profile : T hooks: 170.789726 2019-11-14 18:05:14.862: INFO @main_loop : Epoch 80 done 2019-11-14 18:05:14.862: INFO @main_loop : Training epoch 81 2019-11-14 18:08:03.765: INFO @log_variables: train loss nanmean: 0.066338 2019-11-14 18:08:03.765: INFO @log_variables: train positive_distance nanmean: 0.570040 2019-11-14 18:08:03.765: INFO @log_variables: train negative_distance nanmean: 1.419138 2019-11-14 18:08:03.765: INFO @log_variables: valid loss nanmean: 0.274126 2019-11-14 18:08:03.765: INFO @log_variables: valid positive_distance nanmean: 0.656333 2019-11-14 18:08:03.765: INFO @log_variables: valid negative_distance nanmean: 1.397792 2019-11-14 18:08:03.765: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:10:49.550: INFO @metrics_hook: train matching accuracy: 0.9930736400462963, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-14 18:10:50.983: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:10:51.146: INFO @evaluate_embedding: best threshold 1.0270623564720156 2019-11-14 18:10:51.215: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:10:51.215: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:10:51.381: INFO @decay_lr : LR updated to `0.0006662997` 2019-11-14 18:10:51.382: INFO @log_profile : T train: 47.765816 2019-11-14 18:10:51.382: INFO @log_profile : T valid: 1.460584 2019-11-14 18:10:51.383: INFO @log_profile : T read data: 111.866674 2019-11-14 18:10:51.383: INFO @log_profile : T hooks: 175.348829 2019-11-14 18:10:51.383: INFO @main_loop : Epoch 81 done 2019-11-14 18:10:51.383: INFO @main_loop : Training epoch 82 2019-11-14 18:13:42.228: INFO @log_variables: train loss nanmean: 0.066626 2019-11-14 18:13:42.228: INFO @log_variables: train positive_distance nanmean: 0.570078 2019-11-14 18:13:42.228: INFO @log_variables: train negative_distance nanmean: 1.419133 2019-11-14 18:13:42.229: INFO @log_variables: valid loss nanmean: 0.275703 2019-11-14 18:13:42.229: INFO @log_variables: valid positive_distance nanmean: 0.650681 2019-11-14 18:13:42.229: INFO @log_variables: valid negative_distance nanmean: 1.396118 2019-11-14 18:13:42.229: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:16:28.279: INFO @metrics_hook: train matching accuracy: 0.9927481192129629, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-14 18:16:29.747: INFO @metrics_hook: valid matching accuracy: 0.985816359176709, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:16:29.923: INFO @evaluate_embedding: best threshold 1.0233994722366333 2019-11-14 18:16:30.013: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:16:30.013: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:16:30.213: INFO @decay_lr : LR updated to `0.0006629682` 2019-11-14 18:16:30.216: INFO @log_profile : T train: 49.391055 2019-11-14 18:16:30.216: INFO @log_profile : T valid: 1.602832 2019-11-14 18:16:30.216: INFO @log_profile : T read data: 111.198923 2019-11-14 18:16:30.216: INFO @log_profile : T hooks: 176.549533 2019-11-14 18:16:30.216: INFO @main_loop : Epoch 82 done 2019-11-14 18:16:30.216: INFO @main_loop : Training epoch 83 2019-11-14 18:19:18.007: INFO @log_variables: train loss nanmean: 0.065098 2019-11-14 18:19:18.007: INFO @log_variables: train positive_distance nanmean: 0.569552 2019-11-14 18:19:18.007: INFO @log_variables: train negative_distance nanmean: 1.419158 2019-11-14 18:19:18.007: INFO @log_variables: valid loss nanmean: 0.276229 2019-11-14 18:19:18.008: INFO @log_variables: valid positive_distance nanmean: 0.654447 2019-11-14 18:19:18.008: INFO @log_variables: valid negative_distance nanmean: 1.397424 2019-11-14 18:19:18.008: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:21:57.364: INFO @metrics_hook: train matching accuracy: 0.9922688103010191, N=110591, DB_SIZE=110592, N_IDS=7310 2019-11-14 18:21:58.993: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:21:59.167: INFO @evaluate_embedding: best threshold 1.0259357690811157 2019-11-14 18:21:59.242: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:21:59.242: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:21:59.427: INFO @decay_lr : LR updated to `0.00065965333` 2019-11-14 18:21:59.428: INFO @log_profile : T train: 49.928917 2019-11-14 18:21:59.429: INFO @log_profile : T valid: 1.737957 2019-11-14 18:21:59.429: INFO @log_profile : T read data: 106.594991 2019-11-14 18:21:59.429: INFO @log_profile : T hooks: 170.877757 2019-11-14 18:21:59.429: INFO @main_loop : Epoch 83 done 2019-11-14 18:21:59.429: INFO @main_loop : Training epoch 84 2019-11-14 18:24:47.147: INFO @log_variables: train loss nanmean: 0.065428 2019-11-14 18:24:47.150: INFO @log_variables: train positive_distance nanmean: 0.569736 2019-11-14 18:24:47.150: INFO @log_variables: train negative_distance nanmean: 1.419160 2019-11-14 18:24:47.150: INFO @log_variables: valid loss nanmean: 0.279402 2019-11-14 18:24:47.150: INFO @log_variables: valid positive_distance nanmean: 0.651983 2019-11-14 18:24:47.150: INFO @log_variables: valid negative_distance nanmean: 1.396962 2019-11-14 18:24:47.150: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:27:28.945: INFO @metrics_hook: train matching accuracy: 0.9930645978009259, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-14 18:27:30.657: INFO @metrics_hook: valid matching accuracy: 0.985283139596886, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:27:30.858: INFO @evaluate_embedding: best threshold 1.0244721770286558 2019-11-14 18:27:30.945: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:27:30.945: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:27:31.190: INFO @decay_lr : LR updated to `0.00065635506` 2019-11-14 18:27:31.192: INFO @log_profile : T train: 47.286964 2019-11-14 18:27:31.192: INFO @log_profile : T valid: 1.668852 2019-11-14 18:27:31.192: INFO @log_profile : T read data: 108.896981 2019-11-14 18:27:31.192: INFO @log_profile : T hooks: 173.836242 2019-11-14 18:27:31.192: INFO @main_loop : Epoch 84 done 2019-11-14 18:27:31.193: INFO @main_loop : Training epoch 85 2019-11-14 18:30:12.002: INFO @log_variables: train loss nanmean: 0.067157 2019-11-14 18:30:12.003: INFO @log_variables: train positive_distance nanmean: 0.569793 2019-11-14 18:30:12.003: INFO @log_variables: train negative_distance nanmean: 1.419149 2019-11-14 18:30:12.003: INFO @log_variables: valid loss nanmean: 0.275799 2019-11-14 18:30:12.003: INFO @log_variables: valid positive_distance nanmean: 0.654348 2019-11-14 18:30:12.003: INFO @log_variables: valid negative_distance nanmean: 1.398731 2019-11-14 18:30:12.003: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:32:53.854: INFO @metrics_hook: train matching accuracy: 0.9933358651620371, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-14 18:32:55.225: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:32:55.425: INFO @evaluate_embedding: best threshold 1.0265392959117887 2019-11-14 18:32:55.504: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:32:55.504: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:32:55.721: INFO @decay_lr : LR updated to `0.0006530733` 2019-11-14 18:32:55.723: INFO @log_profile : T train: 47.913980 2019-11-14 18:32:55.723: INFO @log_profile : T valid: 1.727955 2019-11-14 18:32:55.723: INFO @log_profile : T read data: 101.895730 2019-11-14 18:32:55.723: INFO @log_profile : T hooks: 172.913316 2019-11-14 18:32:55.723: INFO @main_loop : Epoch 85 done 2019-11-14 18:32:55.723: INFO @main_loop : Training epoch 86 2019-11-14 18:35:34.352: INFO @log_variables: train loss nanmean: 0.064228 2019-11-14 18:35:34.352: INFO @log_variables: train positive_distance nanmean: 0.567946 2019-11-14 18:35:34.353: INFO @log_variables: train negative_distance nanmean: 1.419208 2019-11-14 18:35:34.353: INFO @log_variables: valid loss nanmean: 0.272614 2019-11-14 18:35:34.353: INFO @log_variables: valid positive_distance nanmean: 0.656019 2019-11-14 18:35:34.353: INFO @log_variables: valid negative_distance nanmean: 1.398242 2019-11-14 18:35:34.353: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:38:16.513: INFO @metrics_hook: train matching accuracy: 0.9930374710648148, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-14 18:38:17.991: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:38:18.206: INFO @evaluate_embedding: best threshold 1.0271306931972504 2019-11-14 18:38:18.288: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:38:18.288: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:38:18.515: INFO @decay_lr : LR updated to `0.0006498079` 2019-11-14 18:38:18.517: INFO @log_profile : T train: 46.958593 2019-11-14 18:38:18.517: INFO @log_profile : T valid: 1.543387 2019-11-14 18:38:18.517: INFO @log_profile : T read data: 100.222319 2019-11-14 18:38:18.517: INFO @log_profile : T hooks: 173.985070 2019-11-14 18:38:18.517: INFO @main_loop : Epoch 86 done 2019-11-14 18:38:18.517: INFO @main_loop : Training epoch 87 2019-11-14 18:40:55.416: INFO @log_variables: train loss nanmean: 0.065216 2019-11-14 18:40:55.416: INFO @log_variables: train positive_distance nanmean: 0.569403 2019-11-14 18:40:55.417: INFO @log_variables: train negative_distance nanmean: 1.419163 2019-11-14 18:40:55.417: INFO @log_variables: valid loss nanmean: 0.280951 2019-11-14 18:40:55.417: INFO @log_variables: valid positive_distance nanmean: 0.657260 2019-11-14 18:40:55.417: INFO @log_variables: valid negative_distance nanmean: 1.397756 2019-11-14 18:40:55.417: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:43:37.991: INFO @metrics_hook: train matching accuracy: 0.992295937282419, N=110591, DB_SIZE=110592, N_IDS=7302 2019-11-14 18:43:39.623: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:43:39.833: INFO @evaluate_embedding: best threshold 1.0275080502033231 2019-11-14 18:43:39.931: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:43:39.931: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:43:40.139: INFO @decay_lr : LR updated to `0.0006465589` 2019-11-14 18:43:40.140: INFO @log_profile : T train: 47.544414 2019-11-14 18:43:40.140: INFO @log_profile : T valid: 1.507200 2019-11-14 18:43:40.140: INFO @log_profile : T read data: 98.281309 2019-11-14 18:43:40.140: INFO @log_profile : T hooks: 174.214210 2019-11-14 18:43:40.140: INFO @main_loop : Epoch 87 done 2019-11-14 18:43:40.140: INFO @main_loop : Training epoch 88 2019-11-14 18:46:12.118: INFO @log_variables: train loss nanmean: 0.063298 2019-11-14 18:46:12.119: INFO @log_variables: train positive_distance nanmean: 0.568525 2019-11-14 18:46:12.119: INFO @log_variables: train negative_distance nanmean: 1.419189 2019-11-14 18:46:12.119: INFO @log_variables: valid loss nanmean: 0.280911 2019-11-14 18:46:12.119: INFO @log_variables: valid positive_distance nanmean: 0.658334 2019-11-14 18:46:12.119: INFO @log_variables: valid negative_distance nanmean: 1.397027 2019-11-14 18:46:12.120: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:48:53.446: INFO @metrics_hook: train matching accuracy: 0.9928023726851852, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-14 18:48:55.152: INFO @metrics_hook: valid matching accuracy: 0.9853897835128506, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:48:55.332: INFO @evaluate_embedding: best threshold 1.0276806354522705 2019-11-14 18:48:55.432: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:48:55.432: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:48:55.672: INFO @decay_lr : LR updated to `0.0006433261` 2019-11-14 18:48:55.674: INFO @log_profile : T train: 48.886258 2019-11-14 18:48:55.674: INFO @log_profile : T valid: 1.738066 2019-11-14 18:48:55.674: INFO @log_profile : T read data: 91.960493 2019-11-14 18:48:55.674: INFO @log_profile : T hooks: 172.841057 2019-11-14 18:48:55.674: INFO @main_loop : Epoch 88 done 2019-11-14 18:48:55.674: INFO @main_loop : Training epoch 89 2019-11-14 18:51:32.381: INFO @log_variables: train loss nanmean: 0.064882 2019-11-14 18:51:32.382: INFO @log_variables: train positive_distance nanmean: 0.570014 2019-11-14 18:51:32.382: INFO @log_variables: train negative_distance nanmean: 1.419169 2019-11-14 18:51:32.382: INFO @log_variables: valid loss nanmean: 0.276890 2019-11-14 18:51:32.383: INFO @log_variables: valid positive_distance nanmean: 0.658479 2019-11-14 18:51:32.383: INFO @log_variables: valid negative_distance nanmean: 1.399585 2019-11-14 18:51:32.383: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:54:15.155: INFO @metrics_hook: train matching accuracy: 0.9923231336805556, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-14 18:54:16.716: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:54:16.915: INFO @evaluate_embedding: best threshold 1.0290317833423612 2019-11-14 18:54:17.011: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:54:17.011: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:54:17.222: INFO @decay_lr : LR updated to `0.0006401095` 2019-11-14 18:54:17.224: INFO @log_profile : T train: 47.273147 2019-11-14 18:54:17.224: INFO @log_profile : T valid: 1.464988 2019-11-14 18:54:17.224: INFO @log_profile : T read data: 98.320505 2019-11-14 18:54:17.224: INFO @log_profile : T hooks: 174.400878 2019-11-14 18:54:17.224: INFO @main_loop : Epoch 89 done 2019-11-14 18:54:17.224: INFO @main_loop : Training epoch 90 2019-11-14 18:56:47.123: INFO @log_variables: train loss nanmean: 0.063292 2019-11-14 18:56:47.124: INFO @log_variables: train positive_distance nanmean: 0.568179 2019-11-14 18:56:47.124: INFO @log_variables: train negative_distance nanmean: 1.419153 2019-11-14 18:56:47.124: INFO @log_variables: valid loss nanmean: 0.281038 2019-11-14 18:56:47.124: INFO @log_variables: valid positive_distance nanmean: 0.653403 2019-11-14 18:56:47.124: INFO @log_variables: valid negative_distance nanmean: 1.397159 2019-11-14 18:56:47.124: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 18:59:27.409: INFO @metrics_hook: train matching accuracy: 0.9928656684027778, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-14 18:59:28.870: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 18:59:29.073: INFO @evaluate_embedding: best threshold 1.0252810120582583 2019-11-14 18:59:29.160: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 18:59:29.160: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 18:59:29.378: INFO @decay_lr : LR updated to `0.0006369089` 2019-11-14 18:59:29.379: INFO @log_profile : T train: 46.991077 2019-11-14 18:59:29.380: INFO @log_profile : T valid: 1.464688 2019-11-14 18:59:29.380: INFO @log_profile : T read data: 91.971630 2019-11-14 18:59:29.380: INFO @log_profile : T hooks: 171.649520 2019-11-14 18:59:29.380: INFO @main_loop : Epoch 90 done 2019-11-14 18:59:29.380: INFO @main_loop : Training epoch 91 2019-11-14 19:01:55.584: INFO @log_variables: train loss nanmean: 0.062528 2019-11-14 19:01:55.585: INFO @log_variables: train positive_distance nanmean: 0.569376 2019-11-14 19:01:55.585: INFO @log_variables: train negative_distance nanmean: 1.419166 2019-11-14 19:01:55.585: INFO @log_variables: valid loss nanmean: 0.278767 2019-11-14 19:01:55.585: INFO @log_variables: valid positive_distance nanmean: 0.655429 2019-11-14 19:01:55.585: INFO @log_variables: valid negative_distance nanmean: 1.397526 2019-11-14 19:01:55.586: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:04:30.744: INFO @metrics_hook: train matching accuracy: 0.9929560271631507, N=110591, DB_SIZE=110592, N_IDS=7314 2019-11-14 19:04:32.258: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:04:32.444: INFO @evaluate_embedding: best threshold 1.0264773964881897 2019-11-14 19:04:32.522: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:04:32.522: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:04:32.736: INFO @decay_lr : LR updated to `0.0006337244` 2019-11-14 19:04:32.737: INFO @log_profile : T train: 48.916439 2019-11-14 19:04:32.738: INFO @log_profile : T valid: 1.744225 2019-11-14 19:04:32.738: INFO @log_profile : T read data: 86.007515 2019-11-14 19:04:32.738: INFO @log_profile : T hooks: 166.617429 2019-11-14 19:04:32.738: INFO @main_loop : Epoch 91 done 2019-11-14 19:04:32.738: INFO @main_loop : Training epoch 92 2019-11-14 19:06:50.925: INFO @log_variables: train loss nanmean: 0.063880 2019-11-14 19:06:50.926: INFO @log_variables: train positive_distance nanmean: 0.569400 2019-11-14 19:06:50.926: INFO @log_variables: train negative_distance nanmean: 1.419179 2019-11-14 19:06:50.926: INFO @log_variables: valid loss nanmean: 0.286259 2019-11-14 19:06:50.926: INFO @log_variables: valid positive_distance nanmean: 0.655599 2019-11-14 19:06:50.926: INFO @log_variables: valid negative_distance nanmean: 1.396472 2019-11-14 19:06:50.926: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:09:37.937: INFO @metrics_hook: train matching accuracy: 0.9925672743055556, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-14 19:09:39.381: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:09:39.571: INFO @evaluate_embedding: best threshold 1.0260358750820158 2019-11-14 19:09:39.660: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:09:39.661: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:09:39.894: INFO @decay_lr : LR updated to `0.00063055573` 2019-11-14 19:09:39.895: INFO @log_profile : T train: 46.524025 2019-11-14 19:09:39.895: INFO @log_profile : T valid: 1.490445 2019-11-14 19:09:39.895: INFO @log_profile : T read data: 80.789250 2019-11-14 19:09:39.896: INFO @log_profile : T hooks: 178.273235 2019-11-14 19:09:39.896: INFO @main_loop : Epoch 92 done 2019-11-14 19:09:39.896: INFO @main_loop : Training epoch 93 2019-11-14 19:12:00.261: INFO @log_variables: train loss nanmean: 0.062348 2019-11-14 19:12:00.262: INFO @log_variables: train positive_distance nanmean: 0.568792 2019-11-14 19:12:00.262: INFO @log_variables: train negative_distance nanmean: 1.419183 2019-11-14 19:12:00.262: INFO @log_variables: valid loss nanmean: 0.277065 2019-11-14 19:12:00.262: INFO @log_variables: valid positive_distance nanmean: 0.650357 2019-11-14 19:12:00.263: INFO @log_variables: valid negative_distance nanmean: 1.396257 2019-11-14 19:12:00.263: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:14:42.006: INFO @metrics_hook: train matching accuracy: 0.9929560271631507, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-14 19:14:43.605: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:14:43.815: INFO @evaluate_embedding: best threshold 1.0233071446418762 2019-11-14 19:14:43.903: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:14:43.903: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:14:44.112: INFO @decay_lr : LR updated to `0.000627403` 2019-11-14 19:14:44.114: INFO @log_profile : T train: 47.065691 2019-11-14 19:14:44.114: INFO @log_profile : T valid: 1.535426 2019-11-14 19:14:44.114: INFO @log_profile : T read data: 81.760068 2019-11-14 19:14:44.114: INFO @log_profile : T hooks: 173.778630 2019-11-14 19:14:44.114: INFO @main_loop : Epoch 93 done 2019-11-14 19:14:44.114: INFO @main_loop : Training epoch 94 2019-11-14 19:17:02.230: INFO @log_variables: train loss nanmean: 0.061364 2019-11-14 19:17:02.230: INFO @log_variables: train positive_distance nanmean: 0.568182 2019-11-14 19:17:02.232: INFO @log_variables: train negative_distance nanmean: 1.419199 2019-11-14 19:17:02.232: INFO @log_variables: valid loss nanmean: 0.278136 2019-11-14 19:17:02.233: INFO @log_variables: valid positive_distance nanmean: 0.655956 2019-11-14 19:17:02.233: INFO @log_variables: valid negative_distance nanmean: 1.398190 2019-11-14 19:17:02.233: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:19:45.435: INFO @metrics_hook: train matching accuracy: 0.9939688223379629, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-14 19:19:47.030: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:19:47.259: INFO @evaluate_embedding: best threshold 1.0270730257034302 2019-11-14 19:19:47.352: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:19:47.353: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:19:47.580: INFO @decay_lr : LR updated to `0.00062426593` 2019-11-14 19:19:47.583: INFO @log_profile : T train: 46.064412 2019-11-14 19:19:47.583: INFO @log_profile : T valid: 1.483319 2019-11-14 19:19:47.583: INFO @log_profile : T read data: 81.297593 2019-11-14 19:19:47.583: INFO @log_profile : T hooks: 174.524781 2019-11-14 19:19:47.583: INFO @main_loop : Epoch 94 done 2019-11-14 19:19:47.583: INFO @main_loop : Training epoch 95 2019-11-14 19:22:01.687: INFO @log_variables: train loss nanmean: 0.061185 2019-11-14 19:22:01.687: INFO @log_variables: train positive_distance nanmean: 0.567924 2019-11-14 19:22:01.687: INFO @log_variables: train negative_distance nanmean: 1.419191 2019-11-14 19:22:01.688: INFO @log_variables: valid loss nanmean: 0.275559 2019-11-14 19:22:01.688: INFO @log_variables: valid positive_distance nanmean: 0.654956 2019-11-14 19:22:01.688: INFO @log_variables: valid negative_distance nanmean: 1.397358 2019-11-14 19:22:01.688: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:24:40.230: INFO @metrics_hook: train matching accuracy: 0.9930193865740741, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-14 19:24:41.530: INFO @metrics_hook: valid matching accuracy: 0.9859230030926736, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:24:41.738: INFO @evaluate_embedding: best threshold 1.0261567533016203 2019-11-14 19:24:41.834: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:24:41.834: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:24:42.031: INFO @decay_lr : LR updated to `0.0006211446` 2019-11-14 19:24:42.032: INFO @log_profile : T train: 46.145714 2019-11-14 19:24:42.032: INFO @log_profile : T valid: 1.469002 2019-11-14 19:24:42.032: INFO @log_profile : T read data: 77.207195 2019-11-14 19:24:42.032: INFO @log_profile : T hooks: 169.547041 2019-11-14 19:24:42.032: INFO @main_loop : Epoch 95 done 2019-11-14 19:24:42.032: INFO @main_loop : Training epoch 96 2019-11-14 19:26:48.664: INFO @log_variables: train loss nanmean: 0.061324 2019-11-14 19:26:48.664: INFO @log_variables: train positive_distance nanmean: 0.568062 2019-11-14 19:26:48.664: INFO @log_variables: train negative_distance nanmean: 1.419156 2019-11-14 19:26:48.664: INFO @log_variables: valid loss nanmean: 0.278757 2019-11-14 19:26:48.664: INFO @log_variables: valid positive_distance nanmean: 0.657605 2019-11-14 19:26:48.664: INFO @log_variables: valid negative_distance nanmean: 1.397871 2019-11-14 19:26:48.664: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:29:27.508: INFO @metrics_hook: train matching accuracy: 0.9924949363425926, N=110592, DB_SIZE=110592, N_IDS=7317 2019-11-14 19:29:28.753: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:29:28.959: INFO @evaluate_embedding: best threshold 1.0277379751205444 2019-11-14 19:29:29.038: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:29:29.038: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:29:29.272: INFO @decay_lr : LR updated to `0.0006180389` 2019-11-14 19:29:29.273: INFO @log_profile : T train: 46.095515 2019-11-14 19:29:29.273: INFO @log_profile : T valid: 1.536571 2019-11-14 19:29:29.274: INFO @log_profile : T read data: 70.014937 2019-11-14 19:29:29.274: INFO @log_profile : T hooks: 169.519721 2019-11-14 19:29:29.274: INFO @main_loop : Epoch 96 done 2019-11-14 19:29:29.274: INFO @main_loop : Training epoch 97 2019-11-14 19:31:32.333: INFO @log_variables: train loss nanmean: 0.061188 2019-11-14 19:31:32.333: INFO @log_variables: train positive_distance nanmean: 0.567861 2019-11-14 19:31:32.333: INFO @log_variables: train negative_distance nanmean: 1.419188 2019-11-14 19:31:32.333: INFO @log_variables: valid loss nanmean: 0.280757 2019-11-14 19:31:32.333: INFO @log_variables: valid positive_distance nanmean: 0.656081 2019-11-14 19:31:32.333: INFO @log_variables: valid negative_distance nanmean: 1.397184 2019-11-14 19:31:32.334: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:34:14.275: INFO @metrics_hook: train matching accuracy: 0.9933720341435185, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-14 19:34:15.858: INFO @metrics_hook: valid matching accuracy: 0.985816359176709, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:34:16.076: INFO @evaluate_embedding: best threshold 1.0266322195529936 2019-11-14 19:34:16.164: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:34:16.165: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:34:16.362: INFO @decay_lr : LR updated to `0.0006149487` 2019-11-14 19:34:16.364: INFO @log_profile : T train: 45.812311 2019-11-14 19:34:16.364: INFO @log_profile : T valid: 1.554542 2019-11-14 19:34:16.364: INFO @log_profile : T read data: 66.195307 2019-11-14 19:34:16.364: INFO @log_profile : T hooks: 173.444246 2019-11-14 19:34:16.364: INFO @main_loop : Epoch 97 done 2019-11-14 19:34:16.364: INFO @main_loop : Training epoch 98 2019-11-14 19:36:17.104: INFO @log_variables: train loss nanmean: 0.061493 2019-11-14 19:36:17.104: INFO @log_variables: train positive_distance nanmean: 0.568638 2019-11-14 19:36:17.104: INFO @log_variables: train negative_distance nanmean: 1.419168 2019-11-14 19:36:17.104: INFO @log_variables: valid loss nanmean: 0.273734 2019-11-14 19:36:17.104: INFO @log_variables: valid positive_distance nanmean: 0.656366 2019-11-14 19:36:17.105: INFO @log_variables: valid negative_distance nanmean: 1.398763 2019-11-14 19:36:17.105: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:38:53.596: INFO @metrics_hook: train matching accuracy: 0.9923049796095523, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-14 19:38:55.128: INFO @metrics_hook: valid matching accuracy: 0.985816359176709, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:38:55.319: INFO @evaluate_embedding: best threshold 1.0275646746158602 2019-11-14 19:38:55.401: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:38:55.401: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:38:55.619: INFO @decay_lr : LR updated to `0.0006118739` 2019-11-14 19:38:55.621: INFO @log_profile : T train: 45.802208 2019-11-14 19:38:55.621: INFO @log_profile : T valid: 1.515843 2019-11-14 19:38:55.621: INFO @log_profile : T read data: 63.806683 2019-11-14 19:38:55.621: INFO @log_profile : T hooks: 168.052005 2019-11-14 19:38:55.621: INFO @main_loop : Epoch 98 done 2019-11-14 19:38:55.622: INFO @main_loop : Training epoch 99 2019-11-14 19:40:48.252: INFO @log_variables: train loss nanmean: 0.060657 2019-11-14 19:40:48.253: INFO @log_variables: train positive_distance nanmean: 0.566854 2019-11-14 19:40:48.253: INFO @log_variables: train negative_distance nanmean: 1.419199 2019-11-14 19:40:48.253: INFO @log_variables: valid loss nanmean: 0.276786 2019-11-14 19:40:48.253: INFO @log_variables: valid positive_distance nanmean: 0.656470 2019-11-14 19:40:48.253: INFO @log_variables: valid negative_distance nanmean: 1.398178 2019-11-14 19:40:48.253: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:43:21.856: INFO @metrics_hook: train matching accuracy: 0.9930374081073505, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-14 19:43:23.604: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:43:23.871: INFO @evaluate_embedding: best threshold 1.0273241698741915 2019-11-14 19:43:24.012: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:43:24.013: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:43:24.273: INFO @decay_lr : LR updated to `0.00060881453` 2019-11-14 19:43:24.275: INFO @log_profile : T train: 47.262126 2019-11-14 19:43:24.275: INFO @log_profile : T valid: 1.365419 2019-11-14 19:43:24.275: INFO @log_profile : T read data: 57.824383 2019-11-14 19:43:24.275: INFO @log_profile : T hooks: 162.089584 2019-11-14 19:43:24.275: INFO @main_loop : Epoch 99 done 2019-11-14 19:43:24.275: INFO @main_loop : Training epoch 100 2019-11-14 19:45:26.957: INFO @log_variables: train loss nanmean: 0.059990 2019-11-14 19:45:26.957: INFO @log_variables: train positive_distance nanmean: 0.567562 2019-11-14 19:45:26.957: INFO @log_variables: train negative_distance nanmean: 1.419193 2019-11-14 19:45:26.957: INFO @log_variables: valid loss nanmean: 0.281857 2019-11-14 19:45:26.957: INFO @log_variables: valid positive_distance nanmean: 0.652291 2019-11-14 19:45:26.957: INFO @log_variables: valid negative_distance nanmean: 1.396478 2019-11-14 19:45:26.957: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:48:00.038: INFO @metrics_hook: train matching accuracy: 0.9931911276686168, N=110591, DB_SIZE=110592, N_IDS=7312 2019-11-14 19:48:01.565: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:48:01.876: INFO @evaluate_embedding: best threshold 1.0243845880031586 2019-11-14 19:48:01.993: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:48:01.994: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:48:02.314: INFO @decay_lr : LR updated to `0.00060577044` 2019-11-14 19:48:02.316: INFO @log_profile : T train: 46.489801 2019-11-14 19:48:02.316: INFO @log_profile : T valid: 1.487603 2019-11-14 19:48:02.316: INFO @log_profile : T read data: 68.335378 2019-11-14 19:48:02.316: INFO @log_profile : T hooks: 161.649599 2019-11-14 19:48:02.316: INFO @main_loop : Epoch 100 done 2019-11-14 19:48:02.316: INFO @main_loop : Training epoch 101 2019-11-14 19:50:05.140: INFO @log_variables: train loss nanmean: 0.060870 2019-11-14 19:50:05.140: INFO @log_variables: train positive_distance nanmean: 0.568595 2019-11-14 19:50:05.140: INFO @log_variables: train negative_distance nanmean: 1.419183 2019-11-14 19:50:05.140: INFO @log_variables: valid loss nanmean: 0.274415 2019-11-14 19:50:05.140: INFO @log_variables: valid positive_distance nanmean: 0.656624 2019-11-14 19:50:05.140: INFO @log_variables: valid negative_distance nanmean: 1.397507 2019-11-14 19:50:05.141: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:52:41.896: INFO @metrics_hook: train matching accuracy: 0.9931369357638888, N=110592, DB_SIZE=110592, N_IDS=7300 2019-11-14 19:52:43.486: INFO @metrics_hook: valid matching accuracy: 0.9853897835128506, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:52:43.664: INFO @evaluate_embedding: best threshold 1.0270655751228335 2019-11-14 19:52:43.762: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:52:43.763: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:52:44.062: INFO @decay_lr : LR updated to `0.0006027416` 2019-11-14 19:52:44.063: INFO @log_profile : T train: 46.977667 2019-11-14 19:52:44.063: INFO @log_profile : T valid: 1.457019 2019-11-14 19:52:44.064: INFO @log_profile : T read data: 67.743026 2019-11-14 19:52:44.064: INFO @log_profile : T hooks: 165.493963 2019-11-14 19:52:44.064: INFO @main_loop : Epoch 101 done 2019-11-14 19:52:44.064: INFO @main_loop : Training epoch 102 2019-11-14 19:54:55.108: INFO @log_variables: train loss nanmean: 0.059814 2019-11-14 19:54:55.109: INFO @log_variables: train positive_distance nanmean: 0.566018 2019-11-14 19:54:55.109: INFO @log_variables: train negative_distance nanmean: 1.419193 2019-11-14 19:54:55.109: INFO @log_variables: valid loss nanmean: 0.280011 2019-11-14 19:54:55.109: INFO @log_variables: valid positive_distance nanmean: 0.655399 2019-11-14 19:54:55.109: INFO @log_variables: valid negative_distance nanmean: 1.396913 2019-11-14 19:54:55.109: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 19:57:32.112: INFO @metrics_hook: train matching accuracy: 0.9930464504344838, N=110591, DB_SIZE=110592, N_IDS=7304 2019-11-14 19:57:33.341: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 19:57:33.596: INFO @evaluate_embedding: best threshold 1.0261558294296262 2019-11-14 19:57:33.815: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 19:57:33.815: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 19:57:34.071: INFO @decay_lr : LR updated to `0.0005997279` 2019-11-14 19:57:34.073: INFO @log_profile : T train: 46.372474 2019-11-14 19:57:34.073: INFO @log_profile : T valid: 1.428596 2019-11-14 19:57:34.073: INFO @log_profile : T read data: 76.470864 2019-11-14 19:57:34.073: INFO @log_profile : T hooks: 165.654711 2019-11-14 19:57:34.073: INFO @main_loop : Epoch 102 done 2019-11-14 19:57:34.073: INFO @main_loop : Training epoch 103 2019-11-14 19:59:45.861: INFO @log_variables: train loss nanmean: 0.059764 2019-11-14 19:59:45.862: INFO @log_variables: train positive_distance nanmean: 0.566329 2019-11-14 19:59:45.862: INFO @log_variables: train negative_distance nanmean: 1.419192 2019-11-14 19:59:45.862: INFO @log_variables: valid loss nanmean: 0.276806 2019-11-14 19:59:45.862: INFO @log_variables: valid positive_distance nanmean: 0.655045 2019-11-14 19:59:45.862: INFO @log_variables: valid negative_distance nanmean: 1.398015 2019-11-14 19:59:45.862: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:02:19.638: INFO @metrics_hook: train matching accuracy: 0.9925763165509259, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-14 20:02:21.163: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:02:21.418: INFO @evaluate_embedding: best threshold 1.0265302062034605 2019-11-14 20:02:21.507: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:02:21.507: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:02:21.728: INFO @decay_lr : LR updated to `0.0005967293` 2019-11-14 20:02:21.729: INFO @log_profile : T train: 46.509988 2019-11-14 20:02:21.729: INFO @log_profile : T valid: 1.437216 2019-11-14 20:02:21.729: INFO @log_profile : T read data: 77.420853 2019-11-14 20:02:21.730: INFO @log_profile : T hooks: 162.212515 2019-11-14 20:02:21.730: INFO @main_loop : Epoch 103 done 2019-11-14 20:02:21.730: INFO @main_loop : Training epoch 104 2019-11-14 20:04:44.055: INFO @log_variables: train loss nanmean: 0.059229 2019-11-14 20:04:44.055: INFO @log_variables: train positive_distance nanmean: 0.565727 2019-11-14 20:04:44.055: INFO @log_variables: train negative_distance nanmean: 1.419196 2019-11-14 20:04:44.055: INFO @log_variables: valid loss nanmean: 0.281337 2019-11-14 20:04:44.055: INFO @log_variables: valid positive_distance nanmean: 0.657341 2019-11-14 20:04:44.055: INFO @log_variables: valid negative_distance nanmean: 1.397898 2019-11-14 20:04:44.055: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:07:23.458: INFO @metrics_hook: train matching accuracy: 0.9924135561342593, N=110592, DB_SIZE=110592, N_IDS=7317 2019-11-14 20:07:25.060: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:07:25.304: INFO @evaluate_embedding: best threshold 1.0276194214820862 2019-11-14 20:07:25.401: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:07:25.401: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:07:25.657: INFO @decay_lr : LR updated to `0.0005937456` 2019-11-14 20:07:25.658: INFO @log_profile : T train: 48.423878 2019-11-14 20:07:25.658: INFO @log_profile : T valid: 1.589664 2019-11-14 20:07:25.658: INFO @log_profile : T read data: 85.666568 2019-11-14 20:07:25.659: INFO @log_profile : T hooks: 168.173184 2019-11-14 20:07:25.659: INFO @main_loop : Epoch 104 done 2019-11-14 20:07:25.659: INFO @main_loop : Training epoch 105 2019-11-14 20:09:46.439: INFO @log_variables: train loss nanmean: 0.059374 2019-11-14 20:09:46.439: INFO @log_variables: train positive_distance nanmean: 0.566576 2019-11-14 20:09:46.439: INFO @log_variables: train negative_distance nanmean: 1.419188 2019-11-14 20:09:46.439: INFO @log_variables: valid loss nanmean: 0.280446 2019-11-14 20:09:46.439: INFO @log_variables: valid positive_distance nanmean: 0.653295 2019-11-14 20:09:46.439: INFO @log_variables: valid negative_distance nanmean: 1.398549 2019-11-14 20:09:46.439: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:12:26.091: INFO @metrics_hook: train matching accuracy: 0.9928112849263043, N=110590, DB_SIZE=110592, N_IDS=7304 2019-11-14 20:12:27.935: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:12:29.396: INFO @evaluate_embedding: best threshold 1.0259216129779818 2019-11-14 20:12:29.494: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:12:29.494: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:12:29.753: INFO @decay_lr : LR updated to `0.0005907769` 2019-11-14 20:12:29.755: INFO @log_profile : T train: 46.545054 2019-11-14 20:12:29.755: INFO @log_profile : T valid: 1.389363 2019-11-14 20:12:29.755: INFO @log_profile : T read data: 86.550427 2019-11-14 20:12:29.755: INFO @log_profile : T hooks: 169.522876 2019-11-14 20:12:29.756: INFO @main_loop : Epoch 105 done 2019-11-14 20:12:29.756: INFO @main_loop : Training epoch 106 2019-11-14 20:14:51.498: INFO @log_variables: train loss nanmean: 0.057833 2019-11-14 20:14:51.498: INFO @log_variables: train positive_distance nanmean: 0.566075 2019-11-14 20:14:51.498: INFO @log_variables: train negative_distance nanmean: 1.419214 2019-11-14 20:14:51.498: INFO @log_variables: valid loss nanmean: 0.283457 2019-11-14 20:14:51.498: INFO @log_variables: valid positive_distance nanmean: 0.657783 2019-11-14 20:14:51.498: INFO @log_variables: valid negative_distance nanmean: 1.397256 2019-11-14 20:14:51.498: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:17:29.979: INFO @metrics_hook: train matching accuracy: 0.9916720920138888, N=110592, DB_SIZE=110592, N_IDS=7304 2019-11-14 20:17:31.275: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:17:31.488: INFO @evaluate_embedding: best threshold 1.027519375085831 2019-11-14 20:17:31.609: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:17:31.610: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:17:32.022: INFO @decay_lr : LR updated to `0.00058782304` 2019-11-14 20:17:32.024: INFO @log_profile : T train: 47.026586 2019-11-14 20:17:32.024: INFO @log_profile : T valid: 1.421179 2019-11-14 20:17:32.024: INFO @log_profile : T read data: 86.888563 2019-11-14 20:17:32.024: INFO @log_profile : T hooks: 166.842311 2019-11-14 20:17:32.024: INFO @main_loop : Epoch 106 done 2019-11-14 20:17:32.024: INFO @main_loop : Training epoch 107 2019-11-14 20:19:55.140: INFO @log_variables: train loss nanmean: 0.058082 2019-11-14 20:19:55.140: INFO @log_variables: train positive_distance nanmean: 0.566099 2019-11-14 20:19:55.140: INFO @log_variables: train negative_distance nanmean: 1.419206 2019-11-14 20:19:55.140: INFO @log_variables: valid loss nanmean: 0.276269 2019-11-14 20:19:55.140: INFO @log_variables: valid positive_distance nanmean: 0.657212 2019-11-14 20:19:55.141: INFO @log_variables: valid negative_distance nanmean: 1.397971 2019-11-14 20:19:55.141: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:22:29.762: INFO @metrics_hook: train matching accuracy: 0.9930012387988173, N=110591, DB_SIZE=110592, N_IDS=7306 2019-11-14 20:22:31.026: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:22:31.346: INFO @evaluate_embedding: best threshold 1.0275914072990417 2019-11-14 20:22:31.569: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:22:31.569: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:22:31.872: INFO @decay_lr : LR updated to `0.0005848839` 2019-11-14 20:22:31.873: INFO @log_profile : T train: 47.330120 2019-11-14 20:22:31.873: INFO @log_profile : T valid: 1.425642 2019-11-14 20:22:31.873: INFO @log_profile : T read data: 87.731920 2019-11-14 20:22:31.874: INFO @log_profile : T hooks: 163.288772 2019-11-14 20:22:31.874: INFO @main_loop : Epoch 107 done 2019-11-14 20:22:31.874: INFO @main_loop : Training epoch 108 2019-11-14 20:24:58.583: INFO @log_variables: train loss nanmean: 0.057563 2019-11-14 20:24:58.584: INFO @log_variables: train positive_distance nanmean: 0.566107 2019-11-14 20:24:58.584: INFO @log_variables: train negative_distance nanmean: 1.419201 2019-11-14 20:24:58.584: INFO @log_variables: valid loss nanmean: 0.276626 2019-11-14 20:24:58.584: INFO @log_variables: valid positive_distance nanmean: 0.656293 2019-11-14 20:24:58.584: INFO @log_variables: valid negative_distance nanmean: 1.398007 2019-11-14 20:24:58.584: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:27:39.721: INFO @metrics_hook: train matching accuracy: 0.9924044452080187, N=110591, DB_SIZE=110592, N_IDS=7301 2019-11-14 20:27:41.336: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:27:41.545: INFO @evaluate_embedding: best threshold 1.0271502137184143 2019-11-14 20:27:41.675: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:27:41.676: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:27:41.905: INFO @decay_lr : LR updated to `0.0005819595` 2019-11-14 20:27:41.907: INFO @log_profile : T train: 47.841327 2019-11-14 20:27:41.907: INFO @log_profile : T valid: 1.398323 2019-11-14 20:27:41.907: INFO @log_profile : T read data: 90.966678 2019-11-14 20:27:41.907: INFO @log_profile : T hooks: 169.751969 2019-11-14 20:27:41.908: INFO @main_loop : Epoch 108 done 2019-11-14 20:27:41.908: INFO @main_loop : Training epoch 109 2019-11-14 20:30:05.909: INFO @log_variables: train loss nanmean: 0.057698 2019-11-14 20:30:05.909: INFO @log_variables: train positive_distance nanmean: 0.566327 2019-11-14 20:30:05.909: INFO @log_variables: train negative_distance nanmean: 1.419216 2019-11-14 20:30:05.909: INFO @log_variables: valid loss nanmean: 0.285867 2019-11-14 20:30:05.909: INFO @log_variables: valid positive_distance nanmean: 0.661914 2019-11-14 20:30:05.909: INFO @log_variables: valid negative_distance nanmean: 1.397986 2019-11-14 20:30:05.909: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:32:44.760: INFO @metrics_hook: train matching accuracy: 0.9926215277777778, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-14 20:32:46.468: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:32:46.753: INFO @evaluate_embedding: best threshold 1.0299496948719025 2019-11-14 20:32:46.886: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:32:46.886: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:32:47.271: INFO @decay_lr : LR updated to `0.0005790497` 2019-11-14 20:32:47.273: INFO @log_profile : T train: 47.014794 2019-11-14 20:32:47.273: INFO @log_profile : T valid: 1.445543 2019-11-14 20:32:47.273: INFO @log_profile : T read data: 89.017178 2019-11-14 20:32:47.273: INFO @log_profile : T hooks: 167.815273 2019-11-14 20:32:47.273: INFO @main_loop : Epoch 109 done 2019-11-14 20:32:47.273: INFO @main_loop : Training epoch 110 2019-11-14 20:35:14.566: INFO @log_variables: train loss nanmean: 0.057849 2019-11-14 20:35:14.566: INFO @log_variables: train positive_distance nanmean: 0.565853 2019-11-14 20:35:14.566: INFO @log_variables: train negative_distance nanmean: 1.419218 2019-11-14 20:35:14.566: INFO @log_variables: valid loss nanmean: 0.280458 2019-11-14 20:35:14.566: INFO @log_variables: valid positive_distance nanmean: 0.658591 2019-11-14 20:35:14.566: INFO @log_variables: valid negative_distance nanmean: 1.399267 2019-11-14 20:35:14.566: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:37:56.434: INFO @metrics_hook: train matching accuracy: 0.9925128177305157, N=110589, DB_SIZE=110592, N_IDS=7313 2019-11-14 20:37:57.971: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:37:58.312: INFO @evaluate_embedding: best threshold 1.0289291739463806 2019-11-14 20:37:58.465: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:37:58.465: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:37:58.758: INFO @decay_lr : LR updated to `0.00057615445` 2019-11-14 20:37:58.759: INFO @log_profile : T train: 48.274421 2019-11-14 20:37:58.759: INFO @log_profile : T valid: 1.475032 2019-11-14 20:37:58.760: INFO @log_profile : T read data: 90.684978 2019-11-14 20:37:58.760: INFO @log_profile : T hooks: 170.963517 2019-11-14 20:37:58.760: INFO @main_loop : Epoch 110 done 2019-11-14 20:37:58.760: INFO @main_loop : Training epoch 111 2019-11-14 20:40:32.374: INFO @log_variables: train loss nanmean: 0.057736 2019-11-14 20:40:32.374: INFO @log_variables: train positive_distance nanmean: 0.566349 2019-11-14 20:40:32.375: INFO @log_variables: train negative_distance nanmean: 1.419213 2019-11-14 20:40:32.375: INFO @log_variables: valid loss nanmean: 0.280299 2019-11-14 20:40:32.375: INFO @log_variables: valid positive_distance nanmean: 0.658574 2019-11-14 20:40:32.375: INFO @log_variables: valid negative_distance nanmean: 1.397596 2019-11-14 20:40:32.375: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:43:13.113: INFO @metrics_hook: train matching accuracy: 0.9926215277777778, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-14 20:43:14.773: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:43:15.074: INFO @evaluate_embedding: best threshold 1.0280852019786837 2019-11-14 20:43:15.196: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:43:15.196: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:43:15.428: INFO @decay_lr : LR updated to `0.0005732737` 2019-11-14 20:43:15.429: INFO @log_profile : T train: 47.667226 2019-11-14 20:43:15.430: INFO @log_profile : T valid: 1.437080 2019-11-14 20:43:15.430: INFO @log_profile : T read data: 98.426779 2019-11-14 20:43:15.430: INFO @log_profile : T hooks: 169.057772 2019-11-14 20:43:15.430: INFO @main_loop : Epoch 111 done 2019-11-14 20:43:15.430: INFO @main_loop : Training epoch 112 2019-11-14 20:45:50.611: INFO @log_variables: train loss nanmean: 0.057260 2019-11-14 20:45:50.611: INFO @log_variables: train positive_distance nanmean: 0.566376 2019-11-14 20:45:50.611: INFO @log_variables: train negative_distance nanmean: 1.419215 2019-11-14 20:45:50.611: INFO @log_variables: valid loss nanmean: 0.282282 2019-11-14 20:45:50.611: INFO @log_variables: valid positive_distance nanmean: 0.661587 2019-11-14 20:45:50.611: INFO @log_variables: valid negative_distance nanmean: 1.398374 2019-11-14 20:45:50.612: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:48:29.212: INFO @metrics_hook: train matching accuracy: 0.9928204571759259, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-14 20:48:30.914: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:48:31.169: INFO @evaluate_embedding: best threshold 1.0299803316593172 2019-11-14 20:48:31.441: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:48:31.441: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:48:31.817: INFO @decay_lr : LR updated to `0.0005704073` 2019-11-14 20:48:31.820: INFO @log_profile : T train: 47.534204 2019-11-14 20:48:31.820: INFO @log_profile : T valid: 1.455553 2019-11-14 20:48:31.820: INFO @log_profile : T read data: 99.365074 2019-11-14 20:48:31.821: INFO @log_profile : T hooks: 167.965477 2019-11-14 20:48:31.821: INFO @main_loop : Epoch 112 done 2019-11-14 20:48:31.821: INFO @main_loop : Training epoch 113 2019-11-14 20:51:15.878: INFO @log_variables: train loss nanmean: 0.057186 2019-11-14 20:51:15.878: INFO @log_variables: train positive_distance nanmean: 0.565993 2019-11-14 20:51:15.878: INFO @log_variables: train negative_distance nanmean: 1.419217 2019-11-14 20:51:15.878: INFO @log_variables: valid loss nanmean: 0.273291 2019-11-14 20:51:15.878: INFO @log_variables: valid positive_distance nanmean: 0.659080 2019-11-14 20:51:15.878: INFO @log_variables: valid negative_distance nanmean: 1.398568 2019-11-14 20:51:15.878: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:53:53.241: INFO @metrics_hook: train matching accuracy: 0.9933177806712963, N=110592, DB_SIZE=110592, N_IDS=7301 2019-11-14 20:53:55.055: INFO @metrics_hook: valid matching accuracy: 0.985283139596886, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:53:55.239: INFO @evaluate_embedding: best threshold 1.0288241505622864 2019-11-14 20:53:55.325: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:53:55.325: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:53:55.584: INFO @decay_lr : LR updated to `0.00056755525` 2019-11-14 20:53:55.586: INFO @log_profile : T train: 47.089286 2019-11-14 20:53:55.586: INFO @log_profile : T valid: 1.436744 2019-11-14 20:53:55.586: INFO @log_profile : T read data: 108.859065 2019-11-14 20:53:55.586: INFO @log_profile : T hooks: 166.309678 2019-11-14 20:53:55.586: INFO @main_loop : Epoch 113 done 2019-11-14 20:53:55.586: INFO @main_loop : Training epoch 114 2019-11-14 20:56:36.854: INFO @log_variables: train loss nanmean: 0.055897 2019-11-14 20:56:36.854: INFO @log_variables: train positive_distance nanmean: 0.565074 2019-11-14 20:56:36.854: INFO @log_variables: train negative_distance nanmean: 1.419221 2019-11-14 20:56:36.854: INFO @log_variables: valid loss nanmean: 0.271031 2019-11-14 20:56:36.854: INFO @log_variables: valid positive_distance nanmean: 0.658036 2019-11-14 20:56:36.854: INFO @log_variables: valid negative_distance nanmean: 1.399119 2019-11-14 20:56:36.854: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 20:59:15.042: INFO @metrics_hook: train matching accuracy: 0.9924858261522186, N=110591, DB_SIZE=110592, N_IDS=7313 2019-11-14 20:59:16.375: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 20:59:16.840: INFO @evaluate_embedding: best threshold 1.028577834367752 2019-11-14 20:59:16.959: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 20:59:16.959: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 20:59:17.219: INFO @decay_lr : LR updated to `0.00056471745` 2019-11-14 20:59:17.224: INFO @log_profile : T train: 48.228490 2019-11-14 20:59:17.224: INFO @log_profile : T valid: 1.441625 2019-11-14 20:59:17.224: INFO @log_profile : T read data: 104.825758 2019-11-14 20:59:17.224: INFO @log_profile : T hooks: 167.049291 2019-11-14 20:59:17.225: INFO @main_loop : Epoch 114 done 2019-11-14 20:59:17.225: INFO @main_loop : Training epoch 115 2019-11-14 21:01:59.814: INFO @log_variables: train loss nanmean: 0.056560 2019-11-14 21:01:59.815: INFO @log_variables: train positive_distance nanmean: 0.565331 2019-11-14 21:01:59.815: INFO @log_variables: train negative_distance nanmean: 1.419236 2019-11-14 21:01:59.815: INFO @log_variables: valid loss nanmean: 0.271879 2019-11-14 21:01:59.815: INFO @log_variables: valid positive_distance nanmean: 0.655914 2019-11-14 21:01:59.815: INFO @log_variables: valid negative_distance nanmean: 1.397658 2019-11-14 21:01:59.815: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 21:04:46.871: INFO @metrics_hook: train matching accuracy: 0.9928203273352021, N=110590, DB_SIZE=110592, N_IDS=7309 2019-11-14 21:04:48.250: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 21:04:48.497: INFO @evaluate_embedding: best threshold 1.0267861187458038 2019-11-14 21:04:48.621: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 21:04:48.621: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 21:04:48.896: INFO @decay_lr : LR updated to `0.00056189386` 2019-11-14 21:04:48.899: INFO @log_profile : T train: 47.537970 2019-11-14 21:04:48.899: INFO @log_profile : T valid: 1.404526 2019-11-14 21:04:48.899: INFO @log_profile : T read data: 107.311145 2019-11-14 21:04:48.899: INFO @log_profile : T hooks: 175.350745 2019-11-14 21:04:48.899: INFO @main_loop : Epoch 115 done 2019-11-14 21:04:48.899: INFO @main_loop : Training epoch 116 2019-11-14 21:07:30.163: INFO @log_variables: train loss nanmean: 0.057410 2019-11-14 21:07:30.163: INFO @log_variables: train positive_distance nanmean: 0.565900 2019-11-14 21:07:30.163: INFO @log_variables: train negative_distance nanmean: 1.419198 2019-11-14 21:07:30.163: INFO @log_variables: valid loss nanmean: 0.281376 2019-11-14 21:07:30.163: INFO @log_variables: valid positive_distance nanmean: 0.659079 2019-11-14 21:07:30.163: INFO @log_variables: valid negative_distance nanmean: 1.398057 2019-11-14 21:07:30.163: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 21:10:12.901: INFO @metrics_hook: train matching accuracy: 0.9934624565972222, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-14 21:10:14.661: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 21:10:14.975: INFO @evaluate_embedding: best threshold 1.0285679399967194 2019-11-14 21:10:15.145: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 21:10:15.145: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 21:10:15.467: INFO @decay_lr : LR updated to `0.0005590844` 2019-11-14 21:10:15.469: INFO @log_profile : T train: 49.075721 2019-11-14 21:10:15.469: INFO @log_profile : T valid: 1.581032 2019-11-14 21:10:15.469: INFO @log_profile : T read data: 104.379678 2019-11-14 21:10:15.469: INFO @log_profile : T hooks: 171.459189 2019-11-14 21:10:15.469: INFO @main_loop : Epoch 116 done 2019-11-14 21:10:15.469: INFO @main_loop : Training epoch 117 2019-11-14 21:12:59.537: INFO @log_variables: train loss nanmean: 0.055572 2019-11-14 21:12:59.537: INFO @log_variables: train positive_distance nanmean: 0.564577 2019-11-14 21:12:59.537: INFO @log_variables: train negative_distance nanmean: 1.419214 2019-11-14 21:12:59.537: INFO @log_variables: valid loss nanmean: 0.274492 2019-11-14 21:12:59.537: INFO @log_variables: valid positive_distance nanmean: 0.659211 2019-11-14 21:12:59.537: INFO @log_variables: valid negative_distance nanmean: 1.398739 2019-11-14 21:12:59.537: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 21:15:39.334: INFO @metrics_hook: train matching accuracy: 0.9924587673611112, N=110592, DB_SIZE=110592, N_IDS=7305 2019-11-14 21:15:40.858: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 21:15:41.063: INFO @evaluate_embedding: best threshold 1.0289750397205353 2019-11-14 21:15:41.151: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 21:15:41.151: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 21:15:41.378: INFO @decay_lr : LR updated to `0.000556289` 2019-11-14 21:15:41.380: INFO @log_profile : T train: 47.609697 2019-11-14 21:15:41.380: INFO @log_profile : T valid: 1.422581 2019-11-14 21:15:41.380: INFO @log_profile : T read data: 108.380278 2019-11-14 21:15:41.380: INFO @log_profile : T hooks: 168.420232 2019-11-14 21:15:41.380: INFO @main_loop : Epoch 117 done 2019-11-14 21:15:41.380: INFO @main_loop : Training epoch 118 2019-11-14 21:18:26.201: INFO @log_variables: train loss nanmean: 0.054840 2019-11-14 21:18:26.201: INFO @log_variables: train positive_distance nanmean: 0.564340 2019-11-14 21:18:26.201: INFO @log_variables: train negative_distance nanmean: 1.419250 2019-11-14 21:18:26.202: INFO @log_variables: valid loss nanmean: 0.280637 2019-11-14 21:18:26.202: INFO @log_variables: valid positive_distance nanmean: 0.662003 2019-11-14 21:18:26.202: INFO @log_variables: valid negative_distance nanmean: 1.398800 2019-11-14 21:18:26.202: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 21:21:07.809: INFO @metrics_hook: train matching accuracy: 0.9928021774317518, N=110589, DB_SIZE=110592, N_IDS=7306 2019-11-14 21:21:09.496: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 21:21:09.694: INFO @evaluate_embedding: best threshold 1.0304013192653656 2019-11-14 21:21:09.821: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 21:21:09.821: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 21:21:10.173: INFO @decay_lr : LR updated to `0.00055350753` 2019-11-14 21:21:10.175: INFO @log_profile : T train: 49.766191 2019-11-14 21:21:10.175: INFO @log_profile : T valid: 1.602957 2019-11-14 21:21:10.175: INFO @log_profile : T read data: 106.837757 2019-11-14 21:21:10.175: INFO @log_profile : T hooks: 170.517069 2019-11-14 21:21:10.175: INFO @main_loop : Epoch 118 done 2019-11-14 21:21:10.176: INFO @main_loop : Training epoch 119 2019-11-14 21:24:00.705: INFO @log_variables: train loss nanmean: 0.054607 2019-11-14 21:24:00.705: INFO @log_variables: train positive_distance nanmean: 0.564750 2019-11-14 21:24:00.705: INFO @log_variables: train negative_distance nanmean: 1.419216 2019-11-14 21:24:00.705: INFO @log_variables: valid loss nanmean: 0.279745 2019-11-14 21:24:00.705: INFO @log_variables: valid positive_distance nanmean: 0.659186 2019-11-14 21:24:00.705: INFO @log_variables: valid negative_distance nanmean: 1.397854 2019-11-14 21:24:00.705: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 21:26:40.902: INFO @metrics_hook: train matching accuracy: 0.9924767838250852, N=110591, DB_SIZE=110592, N_IDS=7320 2019-11-14 21:26:42.230: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 21:26:42.495: INFO @evaluate_embedding: best threshold 1.0285198986530304 2019-11-14 21:26:42.588: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 21:26:42.588: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 21:26:42.844: INFO @decay_lr : LR updated to `0.00055074` 2019-11-14 21:26:42.860: INFO @log_profile : T train: 49.850284 2019-11-14 21:26:42.860: INFO @log_profile : T valid: 1.595081 2019-11-14 21:26:42.860: INFO @log_profile : T read data: 112.409008 2019-11-14 21:26:42.860: INFO @log_profile : T hooks: 168.759968 2019-11-14 21:26:42.860: INFO @main_loop : Epoch 119 done 2019-11-14 21:26:42.860: INFO @main_loop : Training epoch 120 2019-11-14 21:29:30.207: INFO @log_variables: train loss nanmean: 0.055784 2019-11-14 21:29:30.208: INFO @log_variables: train positive_distance nanmean: 0.565291 2019-11-14 21:29:30.208: INFO @log_variables: train negative_distance nanmean: 1.419244 2019-11-14 21:29:30.208: INFO @log_variables: valid loss nanmean: 0.278720 2019-11-14 21:29:30.208: INFO @log_variables: valid positive_distance nanmean: 0.658922 2019-11-14 21:29:30.208: INFO @log_variables: valid negative_distance nanmean: 1.397262 2019-11-14 21:29:30.208: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 21:32:10.268: INFO @metrics_hook: train matching accuracy: 0.9932996961805556, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-14 21:32:11.602: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 21:32:11.785: INFO @evaluate_embedding: best threshold 1.0280923545360565 2019-11-14 21:32:11.873: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 21:32:11.873: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 21:32:12.148: INFO @decay_lr : LR updated to `0.0005479863` 2019-11-14 21:32:12.155: INFO @log_profile : T train: 48.462946 2019-11-14 21:32:12.155: INFO @log_profile : T valid: 1.422702 2019-11-14 21:32:12.155: INFO @log_profile : T read data: 110.843264 2019-11-14 21:32:12.155: INFO @log_profile : T hooks: 168.488993 2019-11-14 21:32:12.155: INFO @main_loop : Epoch 120 done 2019-11-14 21:32:12.155: INFO @main_loop : Training epoch 121 2019-11-14 21:35:00.748: INFO @log_variables: train loss nanmean: 0.054371 2019-11-14 21:35:00.748: INFO @log_variables: train positive_distance nanmean: 0.566094 2019-11-14 21:35:00.748: INFO @log_variables: train negative_distance nanmean: 1.419226 2019-11-14 21:35:00.748: INFO @log_variables: valid loss nanmean: 0.274097 2019-11-14 21:35:00.748: INFO @log_variables: valid positive_distance nanmean: 0.659202 2019-11-14 21:35:00.748: INFO @log_variables: valid negative_distance nanmean: 1.398368 2019-11-14 21:35:00.748: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 21:37:42.968: INFO @metrics_hook: train matching accuracy: 0.9927933304398148, N=110592, DB_SIZE=110592, N_IDS=7320 2019-11-14 21:37:44.416: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 21:37:44.606: INFO @evaluate_embedding: best threshold 1.0287846922874448 2019-11-14 21:37:44.687: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 21:37:44.687: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 21:37:44.882: INFO @decay_lr : LR updated to `0.00054524635` 2019-11-14 21:37:44.884: INFO @log_profile : T train: 48.971991 2019-11-14 21:37:44.884: INFO @log_profile : T valid: 1.448634 2019-11-14 21:37:44.884: INFO @log_profile : T read data: 111.474739 2019-11-14 21:37:44.884: INFO @log_profile : T hooks: 170.763092 2019-11-14 21:37:44.884: INFO @main_loop : Epoch 121 done 2019-11-14 21:37:44.884: INFO @main_loop : Training epoch 122 2019-11-14 21:40:33.426: INFO @log_variables: train loss nanmean: 0.054817 2019-11-14 21:40:33.426: INFO @log_variables: train positive_distance nanmean: 0.566184 2019-11-14 21:40:33.426: INFO @log_variables: train negative_distance nanmean: 1.419229 2019-11-14 21:40:33.426: INFO @log_variables: valid loss nanmean: 0.272751 2019-11-14 21:40:33.426: INFO @log_variables: valid positive_distance nanmean: 0.659364 2019-11-14 21:40:33.426: INFO @log_variables: valid negative_distance nanmean: 1.398070 2019-11-14 21:40:33.426: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 21:43:17.018: INFO @metrics_hook: train matching accuracy: 0.9928385416666666, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-14 21:43:18.273: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 21:43:18.432: INFO @evaluate_embedding: best threshold 1.028716802597046 2019-11-14 21:43:18.515: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 21:43:18.515: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 21:43:18.694: INFO @decay_lr : LR updated to `0.00054252014` 2019-11-14 21:43:18.696: INFO @log_profile : T train: 50.208437 2019-11-14 21:43:18.696: INFO @log_profile : T valid: 1.414227 2019-11-14 21:43:18.696: INFO @log_profile : T read data: 110.419660 2019-11-14 21:43:18.696: INFO @log_profile : T hooks: 171.672626 2019-11-14 21:43:18.696: INFO @main_loop : Epoch 122 done 2019-11-14 21:43:18.696: INFO @main_loop : Training epoch 123 2019-11-14 21:46:12.009: INFO @log_variables: train loss nanmean: 0.053317 2019-11-14 21:46:12.010: INFO @log_variables: train positive_distance nanmean: 0.563891 2019-11-14 21:46:12.010: INFO @log_variables: train negative_distance nanmean: 1.419212 2019-11-14 21:46:12.010: INFO @log_variables: valid loss nanmean: 0.277167 2019-11-14 21:46:12.010: INFO @log_variables: valid positive_distance nanmean: 0.658984 2019-11-14 21:46:12.010: INFO @log_variables: valid negative_distance nanmean: 1.397588 2019-11-14 21:46:12.010: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 21:48:51.754: INFO @metrics_hook: train matching accuracy: 0.9926667390046297, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-14 21:48:53.167: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 21:48:53.345: INFO @evaluate_embedding: best threshold 1.028286278247833 2019-11-14 21:48:53.410: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 21:48:53.410: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 21:48:53.623: INFO @decay_lr : LR updated to `0.00053980754` 2019-11-14 21:48:53.625: INFO @log_profile : T train: 48.506528 2019-11-14 21:48:53.626: INFO @log_profile : T valid: 1.461956 2019-11-14 21:48:53.626: INFO @log_profile : T read data: 116.793543 2019-11-14 21:48:53.626: INFO @log_profile : T hooks: 168.097274 2019-11-14 21:48:53.626: INFO @main_loop : Epoch 123 done 2019-11-14 21:48:53.626: INFO @main_loop : Training epoch 124 2019-11-14 21:51:45.086: INFO @log_variables: train loss nanmean: 0.054998 2019-11-14 21:51:45.087: INFO @log_variables: train positive_distance nanmean: 0.564490 2019-11-14 21:51:45.087: INFO @log_variables: train negative_distance nanmean: 1.419230 2019-11-14 21:51:45.087: INFO @log_variables: valid loss nanmean: 0.272680 2019-11-14 21:51:45.087: INFO @log_variables: valid positive_distance nanmean: 0.661908 2019-11-14 21:51:45.087: INFO @log_variables: valid negative_distance nanmean: 1.398668 2019-11-14 21:51:45.087: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 21:54:27.488: INFO @metrics_hook: train matching accuracy: 0.9931369357638888, N=110592, DB_SIZE=110592, N_IDS=7322 2019-11-14 21:54:28.735: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 21:54:28.914: INFO @evaluate_embedding: best threshold 1.030287832021713 2019-11-14 21:54:28.988: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 21:54:28.988: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 21:54:29.221: INFO @decay_lr : LR updated to `0.0005371085` 2019-11-14 21:54:29.223: INFO @log_profile : T train: 50.038767 2019-11-14 21:54:29.223: INFO @log_profile : T valid: 1.623200 2019-11-14 21:54:29.223: INFO @log_profile : T read data: 112.574418 2019-11-14 21:54:29.224: INFO @log_profile : T hooks: 171.288585 2019-11-14 21:54:29.224: INFO @main_loop : Epoch 124 done 2019-11-14 21:54:29.224: INFO @main_loop : Training epoch 125 2019-11-14 21:57:18.242: INFO @log_variables: train loss nanmean: 0.053155 2019-11-14 21:57:18.242: INFO @log_variables: train positive_distance nanmean: 0.563470 2019-11-14 21:57:18.242: INFO @log_variables: train negative_distance nanmean: 1.419248 2019-11-14 21:57:18.242: INFO @log_variables: valid loss nanmean: 0.278213 2019-11-14 21:57:18.242: INFO @log_variables: valid positive_distance nanmean: 0.657623 2019-11-14 21:57:18.242: INFO @log_variables: valid negative_distance nanmean: 1.397711 2019-11-14 21:57:18.242: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:00:01.252: INFO @metrics_hook: train matching accuracy: 0.9930463875576454, N=110590, DB_SIZE=110592, N_IDS=7312 2019-11-14 22:00:02.539: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:00:02.731: INFO @evaluate_embedding: best threshold 1.0276667177677155 2019-11-14 22:00:02.808: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:00:02.808: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:00:03.005: INFO @decay_lr : LR updated to `0.000534423` 2019-11-14 22:00:03.007: INFO @log_profile : T train: 49.998904 2019-11-14 22:00:03.007: INFO @log_profile : T valid: 1.681943 2019-11-14 22:00:03.007: INFO @log_profile : T read data: 109.116176 2019-11-14 22:00:03.007: INFO @log_profile : T hooks: 172.909175 2019-11-14 22:00:03.007: INFO @main_loop : Epoch 125 done 2019-11-14 22:00:03.007: INFO @main_loop : Training epoch 126 2019-11-14 22:02:48.448: INFO @log_variables: train loss nanmean: 0.052755 2019-11-14 22:02:48.449: INFO @log_variables: train positive_distance nanmean: 0.563879 2019-11-14 22:02:48.449: INFO @log_variables: train negative_distance nanmean: 1.419233 2019-11-14 22:02:48.449: INFO @log_variables: valid loss nanmean: 0.269978 2019-11-14 22:02:48.449: INFO @log_variables: valid positive_distance nanmean: 0.660148 2019-11-14 22:02:48.449: INFO @log_variables: valid negative_distance nanmean: 1.398519 2019-11-14 22:02:48.449: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:05:35.197: INFO @metrics_hook: train matching accuracy: 0.9923954028808855, N=110591, DB_SIZE=110592, N_IDS=7306 2019-11-14 22:05:36.788: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:05:36.995: INFO @evaluate_embedding: best threshold 1.029333263635635 2019-11-14 22:05:37.084: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:05:37.084: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:05:37.341: INFO @decay_lr : LR updated to `0.00053175085` 2019-11-14 22:05:37.343: INFO @log_profile : T train: 47.951750 2019-11-14 22:05:37.343: INFO @log_profile : T valid: 1.447756 2019-11-14 22:05:37.343: INFO @log_profile : T read data: 107.585466 2019-11-14 22:05:37.343: INFO @log_profile : T hooks: 177.281916 2019-11-14 22:05:37.344: INFO @main_loop : Epoch 126 done 2019-11-14 22:05:37.344: INFO @main_loop : Training epoch 127 2019-11-14 22:08:20.248: INFO @log_variables: train loss nanmean: 0.053257 2019-11-14 22:08:20.248: INFO @log_variables: train positive_distance nanmean: 0.564117 2019-11-14 22:08:20.248: INFO @log_variables: train negative_distance nanmean: 1.419246 2019-11-14 22:08:20.249: INFO @log_variables: valid loss nanmean: 0.277222 2019-11-14 22:08:20.249: INFO @log_variables: valid positive_distance nanmean: 0.661338 2019-11-14 22:08:20.249: INFO @log_variables: valid negative_distance nanmean: 1.398004 2019-11-14 22:08:20.249: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:11:03.420: INFO @metrics_hook: train matching accuracy: 0.992431640625, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-14 22:11:04.889: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:11:05.113: INFO @evaluate_embedding: best threshold 1.0296707749366762 2019-11-14 22:11:05.199: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:11:05.199: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:11:05.427: INFO @decay_lr : LR updated to `0.0005290921` 2019-11-14 22:11:05.429: INFO @log_profile : T train: 47.495386 2019-11-14 22:11:05.429: INFO @log_profile : T valid: 1.529138 2019-11-14 22:11:05.429: INFO @log_profile : T read data: 103.958981 2019-11-14 22:11:05.429: INFO @log_profile : T hooks: 175.014433 2019-11-14 22:11:05.429: INFO @main_loop : Epoch 127 done 2019-11-14 22:11:05.429: INFO @main_loop : Training epoch 128 2019-11-14 22:13:49.832: INFO @log_variables: train loss nanmean: 0.053087 2019-11-14 22:13:49.832: INFO @log_variables: train positive_distance nanmean: 0.564351 2019-11-14 22:13:49.832: INFO @log_variables: train negative_distance nanmean: 1.419242 2019-11-14 22:13:49.833: INFO @log_variables: valid loss nanmean: 0.281819 2019-11-14 22:13:49.833: INFO @log_variables: valid positive_distance nanmean: 0.656461 2019-11-14 22:13:49.833: INFO @log_variables: valid negative_distance nanmean: 1.398145 2019-11-14 22:13:49.833: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:16:31.410: INFO @metrics_hook: train matching accuracy: 0.9926937996762847, N=110591, DB_SIZE=110592, N_IDS=7320 2019-11-14 22:16:32.932: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:16:33.128: INFO @evaluate_embedding: best threshold 1.0273030400276184 2019-11-14 22:16:33.225: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:16:33.225: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:16:33.447: INFO @decay_lr : LR updated to `0.0005264466` 2019-11-14 22:16:33.449: INFO @log_profile : T train: 46.920938 2019-11-14 22:16:33.449: INFO @log_profile : T valid: 1.458903 2019-11-14 22:16:33.449: INFO @log_profile : T read data: 107.289000 2019-11-14 22:16:33.449: INFO @log_profile : T hooks: 172.274684 2019-11-14 22:16:33.449: INFO @main_loop : Epoch 128 done 2019-11-14 22:16:33.449: INFO @main_loop : Training epoch 129 2019-11-14 22:19:11.830: INFO @log_variables: train loss nanmean: 0.052873 2019-11-14 22:19:11.830: INFO @log_variables: train positive_distance nanmean: 0.564656 2019-11-14 22:19:11.830: INFO @log_variables: train negative_distance nanmean: 1.419274 2019-11-14 22:19:11.831: INFO @log_variables: valid loss nanmean: 0.278293 2019-11-14 22:19:11.831: INFO @log_variables: valid positive_distance nanmean: 0.662252 2019-11-14 22:19:11.831: INFO @log_variables: valid negative_distance nanmean: 1.398147 2019-11-14 22:19:11.831: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:21:54.586: INFO @metrics_hook: train matching accuracy: 0.9927842881944444, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-14 22:21:55.891: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:21:56.121: INFO @evaluate_embedding: best threshold 1.0301997065544128 2019-11-14 22:21:56.209: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:21:56.210: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:21:56.412: INFO @decay_lr : LR updated to `0.0005238144` 2019-11-14 22:21:56.414: INFO @log_profile : T train: 47.130901 2019-11-14 22:21:56.414: INFO @log_profile : T valid: 1.512245 2019-11-14 22:21:56.414: INFO @log_profile : T read data: 100.679002 2019-11-14 22:21:56.414: INFO @log_profile : T hooks: 173.564309 2019-11-14 22:21:56.414: INFO @main_loop : Epoch 129 done 2019-11-14 22:21:56.415: INFO @main_loop : Training epoch 130 2019-11-14 22:24:31.000: INFO @log_variables: train loss nanmean: 0.052920 2019-11-14 22:24:31.000: INFO @log_variables: train positive_distance nanmean: 0.564868 2019-11-14 22:24:31.000: INFO @log_variables: train negative_distance nanmean: 1.419243 2019-11-14 22:24:31.000: INFO @log_variables: valid loss nanmean: 0.278466 2019-11-14 22:24:31.001: INFO @log_variables: valid positive_distance nanmean: 0.661155 2019-11-14 22:24:31.001: INFO @log_variables: valid negative_distance nanmean: 1.397049 2019-11-14 22:24:31.001: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:27:12.792: INFO @metrics_hook: train matching accuracy: 0.9931730430143502, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-14 22:27:14.401: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:27:14.601: INFO @evaluate_embedding: best threshold 1.029102087020874 2019-11-14 22:27:14.688: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:27:14.688: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:27:14.978: INFO @decay_lr : LR updated to `0.00052119535` 2019-11-14 22:27:14.980: INFO @log_profile : T train: 46.798708 2019-11-14 22:27:14.980: INFO @log_profile : T valid: 1.534125 2019-11-14 22:27:14.980: INFO @log_profile : T read data: 96.403849 2019-11-14 22:27:14.980: INFO @log_profile : T hooks: 173.724527 2019-11-14 22:27:14.980: INFO @main_loop : Epoch 130 done 2019-11-14 22:27:14.980: INFO @main_loop : Training epoch 131 2019-11-14 22:29:46.878: INFO @log_variables: train loss nanmean: 0.053395 2019-11-14 22:29:46.878: INFO @log_variables: train positive_distance nanmean: 0.564484 2019-11-14 22:29:46.878: INFO @log_variables: train negative_distance nanmean: 1.419229 2019-11-14 22:29:46.878: INFO @log_variables: valid loss nanmean: 0.276983 2019-11-14 22:29:46.879: INFO @log_variables: valid positive_distance nanmean: 0.660686 2019-11-14 22:29:46.879: INFO @log_variables: valid negative_distance nanmean: 1.398447 2019-11-14 22:29:46.879: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:32:29.962: INFO @metrics_hook: train matching accuracy: 0.9927751806204845, N=110591, DB_SIZE=110592, N_IDS=7308 2019-11-14 22:32:31.579: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:32:31.759: INFO @evaluate_embedding: best threshold 1.0295661091804504 2019-11-14 22:32:31.848: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:32:31.848: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:32:32.064: INFO @decay_lr : LR updated to `0.0005185894` 2019-11-14 22:32:32.065: INFO @log_profile : T train: 46.379082 2019-11-14 22:32:32.066: INFO @log_profile : T valid: 1.745926 2019-11-14 22:32:32.066: INFO @log_profile : T read data: 94.645089 2019-11-14 22:32:32.066: INFO @log_profile : T hooks: 174.240661 2019-11-14 22:32:32.066: INFO @main_loop : Epoch 131 done 2019-11-14 22:32:32.066: INFO @main_loop : Training epoch 132 2019-11-14 22:35:03.215: INFO @log_variables: train loss nanmean: 0.053085 2019-11-14 22:35:03.216: INFO @log_variables: train positive_distance nanmean: 0.564407 2019-11-14 22:35:03.216: INFO @log_variables: train negative_distance nanmean: 1.419246 2019-11-14 22:35:03.216: INFO @log_variables: valid loss nanmean: 0.275121 2019-11-14 22:35:03.216: INFO @log_variables: valid positive_distance nanmean: 0.664573 2019-11-14 22:35:03.216: INFO @log_variables: valid negative_distance nanmean: 1.399020 2019-11-14 22:35:03.217: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:37:47.961: INFO @metrics_hook: train matching accuracy: 0.9929560908564815, N=110592, DB_SIZE=110592, N_IDS=7321 2019-11-14 22:37:49.870: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:37:50.087: INFO @evaluate_embedding: best threshold 1.0317962765693662 2019-11-14 22:37:50.176: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:37:50.176: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:37:50.401: INFO @decay_lr : LR updated to `0.0005159965` 2019-11-14 22:37:50.403: INFO @log_profile : T train: 47.792184 2019-11-14 22:37:50.403: INFO @log_profile : T valid: 1.623867 2019-11-14 22:37:50.403: INFO @log_profile : T read data: 91.042585 2019-11-14 22:37:50.403: INFO @log_profile : T hooks: 177.801222 2019-11-14 22:37:50.403: INFO @main_loop : Epoch 132 done 2019-11-14 22:37:50.403: INFO @main_loop : Training epoch 133 2019-11-14 22:40:24.136: INFO @log_variables: train loss nanmean: 0.053420 2019-11-14 22:40:24.136: INFO @log_variables: train positive_distance nanmean: 0.563983 2019-11-14 22:40:24.137: INFO @log_variables: train negative_distance nanmean: 1.419238 2019-11-14 22:40:24.137: INFO @log_variables: valid loss nanmean: 0.277152 2019-11-14 22:40:24.137: INFO @log_variables: valid positive_distance nanmean: 0.662131 2019-11-14 22:40:24.137: INFO @log_variables: valid negative_distance nanmean: 1.398937 2019-11-14 22:40:24.137: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:43:06.221: INFO @metrics_hook: train matching accuracy: 0.9925220630787037, N=110592, DB_SIZE=110592, N_IDS=7307 2019-11-14 22:43:07.507: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:43:07.689: INFO @evaluate_embedding: best threshold 1.0305335223674772 2019-11-14 22:43:07.840: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:43:07.840: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:43:08.069: INFO @decay_lr : LR updated to `0.0005134165` 2019-11-14 22:43:08.070: INFO @log_profile : T train: 46.449704 2019-11-14 22:43:08.071: INFO @log_profile : T valid: 1.458831 2019-11-14 22:43:08.071: INFO @log_profile : T read data: 96.276842 2019-11-14 22:43:08.071: INFO @log_profile : T hooks: 173.395612 2019-11-14 22:43:08.071: INFO @main_loop : Epoch 133 done 2019-11-14 22:43:08.071: INFO @main_loop : Training epoch 134 2019-11-14 22:45:34.263: INFO @log_variables: train loss nanmean: 0.053297 2019-11-14 22:45:34.263: INFO @log_variables: train positive_distance nanmean: 0.564331 2019-11-14 22:45:34.264: INFO @log_variables: train negative_distance nanmean: 1.419257 2019-11-14 22:45:34.264: INFO @log_variables: valid loss nanmean: 0.273081 2019-11-14 22:45:34.264: INFO @log_variables: valid positive_distance nanmean: 0.662096 2019-11-14 22:45:34.264: INFO @log_variables: valid negative_distance nanmean: 1.398515 2019-11-14 22:45:34.264: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:48:15.347: INFO @metrics_hook: train matching accuracy: 0.992720860837327, N=110590, DB_SIZE=110592, N_IDS=7300 2019-11-14 22:48:16.701: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:48:16.920: INFO @evaluate_embedding: best threshold 1.0303053259849546 2019-11-14 22:48:17.018: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:48:17.018: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:48:17.238: INFO @decay_lr : LR updated to `0.0005108494` 2019-11-14 22:48:17.240: INFO @log_profile : T train: 46.827833 2019-11-14 22:48:17.240: INFO @log_profile : T valid: 1.574773 2019-11-14 22:48:17.240: INFO @log_profile : T read data: 87.798270 2019-11-14 22:48:17.240: INFO @log_profile : T hooks: 172.892569 2019-11-14 22:48:17.240: INFO @main_loop : Epoch 134 done 2019-11-14 22:48:17.240: INFO @main_loop : Training epoch 135 2019-11-14 22:50:45.693: INFO @log_variables: train loss nanmean: 0.052824 2019-11-14 22:50:45.693: INFO @log_variables: train positive_distance nanmean: 0.563963 2019-11-14 22:50:45.693: INFO @log_variables: train negative_distance nanmean: 1.419261 2019-11-14 22:50:45.693: INFO @log_variables: valid loss nanmean: 0.273857 2019-11-14 22:50:45.694: INFO @log_variables: valid positive_distance nanmean: 0.662754 2019-11-14 22:50:45.694: INFO @log_variables: valid negative_distance nanmean: 1.398528 2019-11-14 22:50:45.694: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:53:26.873: INFO @metrics_hook: train matching accuracy: 0.9931277692377249, N=110590, DB_SIZE=110592, N_IDS=7312 2019-11-14 22:53:28.457: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:53:28.662: INFO @evaluate_embedding: best threshold 1.0306406915187836 2019-11-14 22:53:28.744: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:53:28.744: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:53:28.978: INFO @decay_lr : LR updated to `0.00050829514` 2019-11-14 22:53:28.980: INFO @log_profile : T train: 46.572613 2019-11-14 22:53:28.980: INFO @log_profile : T valid: 1.465843 2019-11-14 22:53:28.980: INFO @log_profile : T read data: 91.405577 2019-11-14 22:53:28.980: INFO @log_profile : T hooks: 172.204752 2019-11-14 22:53:28.980: INFO @main_loop : Epoch 135 done 2019-11-14 22:53:28.980: INFO @main_loop : Training epoch 136 2019-11-14 22:55:50.159: INFO @log_variables: train loss nanmean: 0.051599 2019-11-14 22:55:50.159: INFO @log_variables: train positive_distance nanmean: 0.563643 2019-11-14 22:55:50.159: INFO @log_variables: train negative_distance nanmean: 1.419276 2019-11-14 22:55:50.159: INFO @log_variables: valid loss nanmean: 0.271797 2019-11-14 22:55:50.159: INFO @log_variables: valid positive_distance nanmean: 0.660541 2019-11-14 22:55:50.160: INFO @log_variables: valid negative_distance nanmean: 1.399224 2019-11-14 22:55:50.160: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 22:58:27.685: INFO @metrics_hook: train matching accuracy: 0.9932273582175926, N=110592, DB_SIZE=110592, N_IDS=7317 2019-11-14 22:58:29.399: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 22:58:29.585: INFO @evaluate_embedding: best threshold 1.0298824906349182 2019-11-14 22:58:29.671: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 22:58:29.671: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 22:58:29.910: INFO @decay_lr : LR updated to `0.0005057537` 2019-11-14 22:58:29.911: INFO @log_profile : T train: 46.437755 2019-11-14 22:58:29.911: INFO @log_profile : T valid: 1.489738 2019-11-14 22:58:29.911: INFO @log_profile : T read data: 83.392838 2019-11-14 22:58:29.911: INFO @log_profile : T hooks: 169.538079 2019-11-14 22:58:29.911: INFO @main_loop : Epoch 136 done 2019-11-14 22:58:29.912: INFO @main_loop : Training epoch 137 2019-11-14 23:00:56.829: INFO @log_variables: train loss nanmean: 0.052860 2019-11-14 23:00:56.830: INFO @log_variables: train positive_distance nanmean: 0.564327 2019-11-14 23:00:56.830: INFO @log_variables: train negative_distance nanmean: 1.419287 2019-11-14 23:00:56.830: INFO @log_variables: valid loss nanmean: 0.278977 2019-11-14 23:00:56.830: INFO @log_variables: valid positive_distance nanmean: 0.662691 2019-11-14 23:00:56.830: INFO @log_variables: valid negative_distance nanmean: 1.397894 2019-11-14 23:00:56.830: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:03:38.255: INFO @metrics_hook: train matching accuracy: 0.9927660728818157, N=110590, DB_SIZE=110592, N_IDS=7314 2019-11-14 23:03:39.796: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:03:40.012: INFO @evaluate_embedding: best threshold 1.0302924811840062 2019-11-14 23:03:40.097: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:03:40.097: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:03:40.330: INFO @decay_lr : LR updated to `0.0005032249` 2019-11-14 23:03:40.331: INFO @log_profile : T train: 73.832144 2019-11-14 23:03:40.332: INFO @log_profile : T valid: 4.647651 2019-11-14 23:03:40.332: INFO @log_profile : T read data: 59.511677 2019-11-14 23:03:40.332: INFO @log_profile : T hooks: 172.338417 2019-11-14 23:03:40.332: INFO @main_loop : Epoch 137 done 2019-11-14 23:03:40.332: INFO @main_loop : Training epoch 138 2019-11-14 23:05:54.228: INFO @log_variables: train loss nanmean: 0.051568 2019-11-14 23:05:54.229: INFO @log_variables: train positive_distance nanmean: 0.563777 2019-11-14 23:05:54.229: INFO @log_variables: train negative_distance nanmean: 1.419239 2019-11-14 23:05:54.229: INFO @log_variables: valid loss nanmean: 0.276015 2019-11-14 23:05:54.229: INFO @log_variables: valid positive_distance nanmean: 0.668169 2019-11-14 23:05:54.229: INFO @log_variables: valid negative_distance nanmean: 1.399490 2019-11-14 23:05:54.229: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:08:38.220: INFO @metrics_hook: train matching accuracy: 0.9931911892361112, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-14 23:08:39.711: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:08:39.895: INFO @evaluate_embedding: best threshold 1.0338295996189117 2019-11-14 23:08:41.320: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:08:41.320: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:08:41.570: INFO @decay_lr : LR updated to `0.00050070876` 2019-11-14 23:08:41.571: INFO @log_profile : T train: 46.152496 2019-11-14 23:08:41.571: INFO @log_profile : T valid: 1.549360 2019-11-14 23:08:41.571: INFO @log_profile : T read data: 77.442978 2019-11-14 23:08:41.571: INFO @log_profile : T hooks: 175.997587 2019-11-14 23:08:41.572: INFO @main_loop : Epoch 138 done 2019-11-14 23:08:41.572: INFO @main_loop : Training epoch 139 2019-11-14 23:10:55.069: INFO @log_variables: train loss nanmean: 0.051614 2019-11-14 23:10:55.069: INFO @log_variables: train positive_distance nanmean: 0.562734 2019-11-14 23:10:55.069: INFO @log_variables: train negative_distance nanmean: 1.419266 2019-11-14 23:10:55.069: INFO @log_variables: valid loss nanmean: 0.272194 2019-11-14 23:10:55.069: INFO @log_variables: valid positive_distance nanmean: 0.656923 2019-11-14 23:10:55.069: INFO @log_variables: valid negative_distance nanmean: 1.397403 2019-11-14 23:10:55.069: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:13:36.950: INFO @metrics_hook: train matching accuracy: 0.9932816116898148, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-14 23:13:38.801: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:13:39.010: INFO @evaluate_embedding: best threshold 1.027162730693817 2019-11-14 23:13:39.085: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:13:39.085: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:13:39.315: INFO @decay_lr : LR updated to `0.0004982052` 2019-11-14 23:13:39.318: INFO @log_profile : T train: 46.653916 2019-11-14 23:13:39.318: INFO @log_profile : T valid: 1.752224 2019-11-14 23:13:39.318: INFO @log_profile : T read data: 75.724372 2019-11-14 23:13:39.318: INFO @log_profile : T hooks: 173.532347 2019-11-14 23:13:39.318: INFO @main_loop : Epoch 139 done 2019-11-14 23:13:39.318: INFO @main_loop : Training epoch 140 2019-11-14 23:15:50.865: INFO @log_variables: train loss nanmean: 0.052635 2019-11-14 23:15:50.866: INFO @log_variables: train positive_distance nanmean: 0.563460 2019-11-14 23:15:50.866: INFO @log_variables: train negative_distance nanmean: 1.419266 2019-11-14 23:15:50.866: INFO @log_variables: valid loss nanmean: 0.275189 2019-11-14 23:15:50.866: INFO @log_variables: valid positive_distance nanmean: 0.657728 2019-11-14 23:15:50.866: INFO @log_variables: valid negative_distance nanmean: 1.397336 2019-11-14 23:15:50.867: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:18:35.443: INFO @metrics_hook: train matching accuracy: 0.9931459160329502, N=110591, DB_SIZE=110592, N_IDS=7317 2019-11-14 23:18:37.201: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:18:37.395: INFO @evaluate_embedding: best threshold 1.0275318324565885 2019-11-14 23:18:37.492: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:18:37.492: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:18:37.721: INFO @decay_lr : LR updated to `0.00049571414` 2019-11-14 23:18:37.723: INFO @log_profile : T train: 45.775886 2019-11-14 23:18:37.723: INFO @log_profile : T valid: 1.610169 2019-11-14 23:18:37.723: INFO @log_profile : T read data: 74.806361 2019-11-14 23:18:37.723: INFO @log_profile : T hooks: 176.118449 2019-11-14 23:18:37.723: INFO @main_loop : Epoch 140 done 2019-11-14 23:18:37.723: INFO @main_loop : Training epoch 141 2019-11-14 23:20:50.977: INFO @log_variables: train loss nanmean: 0.052272 2019-11-14 23:20:50.977: INFO @log_variables: train positive_distance nanmean: 0.563064 2019-11-14 23:20:50.978: INFO @log_variables: train negative_distance nanmean: 1.419246 2019-11-14 23:20:50.978: INFO @log_variables: valid loss nanmean: 0.277522 2019-11-14 23:20:50.978: INFO @log_variables: valid positive_distance nanmean: 0.661117 2019-11-14 23:20:50.978: INFO @log_variables: valid negative_distance nanmean: 1.398213 2019-11-14 23:20:50.978: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:23:38.898: INFO @metrics_hook: train matching accuracy: 0.9925039108064851, N=110591, DB_SIZE=110592, N_IDS=7316 2019-11-14 23:23:40.356: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:23:40.580: INFO @evaluate_embedding: best threshold 1.0296649634838104 2019-11-14 23:23:40.667: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:23:40.667: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:23:40.881: INFO @decay_lr : LR updated to `0.00049323554` 2019-11-14 23:23:40.883: INFO @log_profile : T train: 46.119290 2019-11-14 23:23:40.883: INFO @log_profile : T valid: 1.460737 2019-11-14 23:23:40.883: INFO @log_profile : T read data: 76.584051 2019-11-14 23:23:40.883: INFO @log_profile : T hooks: 178.917404 2019-11-14 23:23:40.883: INFO @main_loop : Epoch 141 done 2019-11-14 23:23:40.883: INFO @main_loop : Training epoch 142 2019-11-14 23:25:49.311: INFO @log_variables: train loss nanmean: 0.051195 2019-11-14 23:25:49.312: INFO @log_variables: train positive_distance nanmean: 0.563748 2019-11-14 23:25:49.312: INFO @log_variables: train negative_distance nanmean: 1.419254 2019-11-14 23:25:49.312: INFO @log_variables: valid loss nanmean: 0.274330 2019-11-14 23:25:49.312: INFO @log_variables: valid positive_distance nanmean: 0.663245 2019-11-14 23:25:49.313: INFO @log_variables: valid negative_distance nanmean: 1.399065 2019-11-14 23:25:49.313: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:28:28.886: INFO @metrics_hook: train matching accuracy: 0.9927390113119512, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-14 23:28:30.196: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:28:30.360: INFO @evaluate_embedding: best threshold 1.031154900789261 2019-11-14 23:28:30.442: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:28:30.442: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:28:30.676: INFO @decay_lr : LR updated to `0.00049076934` 2019-11-14 23:28:30.678: INFO @log_profile : T train: 45.711506 2019-11-14 23:28:30.678: INFO @log_profile : T valid: 1.471542 2019-11-14 23:28:30.678: INFO @log_profile : T read data: 72.584934 2019-11-14 23:28:30.678: INFO @log_profile : T hooks: 169.944208 2019-11-14 23:28:30.678: INFO @main_loop : Epoch 142 done 2019-11-14 23:28:30.678: INFO @main_loop : Training epoch 143 2019-11-14 23:30:31.292: INFO @log_variables: train loss nanmean: 0.050982 2019-11-14 23:30:31.292: INFO @log_variables: train positive_distance nanmean: 0.563497 2019-11-14 23:30:31.292: INFO @log_variables: train negative_distance nanmean: 1.419273 2019-11-14 23:30:31.293: INFO @log_variables: valid loss nanmean: 0.279368 2019-11-14 23:30:31.293: INFO @log_variables: valid positive_distance nanmean: 0.659957 2019-11-14 23:30:31.293: INFO @log_variables: valid negative_distance nanmean: 1.397213 2019-11-14 23:30:31.293: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:33:07.632: INFO @metrics_hook: train matching accuracy: 0.9931821469907407, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-14 23:33:09.132: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:33:09.324: INFO @evaluate_embedding: best threshold 1.0285853147506714 2019-11-14 23:33:09.422: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:33:09.423: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:33:09.678: INFO @decay_lr : LR updated to `0.0004883155` 2019-11-14 23:33:09.679: INFO @log_profile : T train: 45.483000 2019-11-14 23:33:09.680: INFO @log_profile : T valid: 1.504238 2019-11-14 23:33:09.680: INFO @log_profile : T read data: 63.758747 2019-11-14 23:33:09.680: INFO @log_profile : T hooks: 168.172611 2019-11-14 23:33:09.680: INFO @main_loop : Epoch 143 done 2019-11-14 23:33:09.680: INFO @main_loop : Training epoch 144 2019-11-14 23:35:09.488: INFO @log_variables: train loss nanmean: 0.051661 2019-11-14 23:35:09.489: INFO @log_variables: train positive_distance nanmean: 0.563813 2019-11-14 23:35:09.489: INFO @log_variables: train negative_distance nanmean: 1.419254 2019-11-14 23:35:09.489: INFO @log_variables: valid loss nanmean: 0.271258 2019-11-14 23:35:09.489: INFO @log_variables: valid positive_distance nanmean: 0.661620 2019-11-14 23:35:09.489: INFO @log_variables: valid negative_distance nanmean: 1.398818 2019-11-14 23:35:09.489: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:37:50.074: INFO @metrics_hook: train matching accuracy: 0.9929469848360174, N=110591, DB_SIZE=110592, N_IDS=7312 2019-11-14 23:37:51.480: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:37:51.697: INFO @evaluate_embedding: best threshold 1.0302186608314514 2019-11-14 23:37:51.787: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:37:51.787: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:37:52.032: INFO @decay_lr : LR updated to `0.0004858739` 2019-11-14 23:37:52.033: INFO @log_profile : T train: 45.546295 2019-11-14 23:37:52.033: INFO @log_profile : T valid: 1.531783 2019-11-14 23:37:52.033: INFO @log_profile : T read data: 63.697960 2019-11-14 23:37:52.033: INFO @log_profile : T hooks: 171.501602 2019-11-14 23:37:52.033: INFO @main_loop : Epoch 144 done 2019-11-14 23:37:52.034: INFO @main_loop : Training epoch 145 2019-11-14 23:39:46.623: INFO @log_variables: train loss nanmean: 0.051028 2019-11-14 23:39:46.623: INFO @log_variables: train positive_distance nanmean: 0.563174 2019-11-14 23:39:46.623: INFO @log_variables: train negative_distance nanmean: 1.419259 2019-11-14 23:39:46.623: INFO @log_variables: valid loss nanmean: 0.277993 2019-11-14 23:39:46.624: INFO @log_variables: valid positive_distance nanmean: 0.662375 2019-11-14 23:39:46.624: INFO @log_variables: valid negative_distance nanmean: 1.399197 2019-11-14 23:39:46.624: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:42:26.458: INFO @metrics_hook: train matching accuracy: 0.993109746724417, N=110591, DB_SIZE=110592, N_IDS=7304 2019-11-14 23:42:28.144: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:42:28.413: INFO @evaluate_embedding: best threshold 1.0307861864566805 2019-11-14 23:42:28.516: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:42:28.516: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:42:28.760: INFO @decay_lr : LR updated to `0.00048344454` 2019-11-14 23:42:28.762: INFO @log_profile : T train: 45.642190 2019-11-14 23:42:28.762: INFO @log_profile : T valid: 1.353254 2019-11-14 23:42:28.762: INFO @log_profile : T read data: 61.793619 2019-11-14 23:42:28.763: INFO @log_profile : T hooks: 167.860767 2019-11-14 23:42:28.763: INFO @main_loop : Epoch 145 done 2019-11-14 23:42:28.763: INFO @main_loop : Training epoch 146 2019-11-14 23:44:25.908: INFO @log_variables: train loss nanmean: 0.050883 2019-11-14 23:44:25.908: INFO @log_variables: train positive_distance nanmean: 0.562346 2019-11-14 23:44:25.908: INFO @log_variables: train negative_distance nanmean: 1.419249 2019-11-14 23:44:25.908: INFO @log_variables: valid loss nanmean: 0.274309 2019-11-14 23:44:25.909: INFO @log_variables: valid positive_distance nanmean: 0.664418 2019-11-14 23:44:25.909: INFO @log_variables: valid negative_distance nanmean: 1.399586 2019-11-14 23:44:25.909: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:47:09.909: INFO @metrics_hook: train matching accuracy: 0.9929198578546174, N=110591, DB_SIZE=110592, N_IDS=7315 2019-11-14 23:47:11.389: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:47:11.670: INFO @evaluate_embedding: best threshold 1.032002180814743 2019-11-14 23:47:11.807: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:47:11.807: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:47:12.090: INFO @decay_lr : LR updated to `0.00048102732` 2019-11-14 23:47:12.092: INFO @log_profile : T train: 45.627393 2019-11-14 23:47:12.092: INFO @log_profile : T valid: 1.404596 2019-11-14 23:47:12.092: INFO @log_profile : T read data: 63.923871 2019-11-14 23:47:12.092: INFO @log_profile : T hooks: 172.288563 2019-11-14 23:47:12.092: INFO @main_loop : Epoch 146 done 2019-11-14 23:47:12.092: INFO @main_loop : Training epoch 147 2019-11-14 23:49:10.336: INFO @log_variables: train loss nanmean: 0.050015 2019-11-14 23:49:10.337: INFO @log_variables: train positive_distance nanmean: 0.562799 2019-11-14 23:49:10.337: INFO @log_variables: train negative_distance nanmean: 1.419279 2019-11-14 23:49:10.337: INFO @log_variables: valid loss nanmean: 0.271624 2019-11-14 23:49:10.337: INFO @log_variables: valid positive_distance nanmean: 0.664074 2019-11-14 23:49:10.337: INFO @log_variables: valid negative_distance nanmean: 1.399317 2019-11-14 23:49:10.337: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:51:46.459: INFO @metrics_hook: train matching accuracy: 0.9929018373842593, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-14 23:51:47.926: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:51:48.282: INFO @evaluate_embedding: best threshold 1.0316958129405975 2019-11-14 23:51:48.389: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:51:48.389: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:51:48.637: INFO @decay_lr : LR updated to `0.00047862218` 2019-11-14 23:51:48.639: INFO @log_profile : T train: 45.796103 2019-11-14 23:51:48.639: INFO @log_profile : T valid: 1.439539 2019-11-14 23:51:48.639: INFO @log_profile : T read data: 64.369152 2019-11-14 23:51:48.639: INFO @log_profile : T hooks: 164.856025 2019-11-14 23:51:48.639: INFO @main_loop : Epoch 147 done 2019-11-14 23:51:48.640: INFO @main_loop : Training epoch 148 2019-11-14 23:53:54.873: INFO @log_variables: train loss nanmean: 0.050838 2019-11-14 23:53:54.874: INFO @log_variables: train positive_distance nanmean: 0.563904 2019-11-14 23:53:54.874: INFO @log_variables: train negative_distance nanmean: 1.419272 2019-11-14 23:53:54.874: INFO @log_variables: valid loss nanmean: 0.276890 2019-11-14 23:53:54.874: INFO @log_variables: valid positive_distance nanmean: 0.663304 2019-11-14 23:53:54.874: INFO @log_variables: valid negative_distance nanmean: 1.399016 2019-11-14 23:53:54.874: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-14 23:56:33.271: INFO @metrics_hook: train matching accuracy: 0.9928112849263043, N=110590, DB_SIZE=110592, N_IDS=7315 2019-11-14 23:56:34.764: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-14 23:56:34.955: INFO @evaluate_embedding: best threshold 1.0311601758003233 2019-11-14 23:56:35.090: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-14 23:56:35.090: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-14 23:56:35.479: INFO @decay_lr : LR updated to `0.00047622906` 2019-11-14 23:56:35.481: INFO @log_profile : T train: 45.940594 2019-11-14 23:56:35.481: INFO @log_profile : T valid: 1.434636 2019-11-14 23:56:35.481: INFO @log_profile : T read data: 72.154531 2019-11-14 23:56:35.481: INFO @log_profile : T hooks: 167.228486 2019-11-14 23:56:35.481: INFO @main_loop : Epoch 148 done 2019-11-14 23:56:35.481: INFO @main_loop : Training epoch 149 2019-11-14 23:58:40.301: INFO @log_variables: train loss nanmean: 0.050166 2019-11-14 23:58:40.301: INFO @log_variables: train positive_distance nanmean: 0.563570 2019-11-14 23:58:40.302: INFO @log_variables: train negative_distance nanmean: 1.419264 2019-11-14 23:58:40.302: INFO @log_variables: valid loss nanmean: 0.273286 2019-11-14 23:58:40.302: INFO @log_variables: valid positive_distance nanmean: 0.663494 2019-11-14 23:58:40.302: INFO @log_variables: valid negative_distance nanmean: 1.399126 2019-11-14 23:58:40.302: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:01:20.350: INFO @metrics_hook: train matching accuracy: 0.9930463875576454, N=110590, DB_SIZE=110592, N_IDS=7310 2019-11-15 00:01:21.904: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:01:22.141: INFO @evaluate_embedding: best threshold 1.0313097238540652 2019-11-15 00:01:22.243: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:01:22.243: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:01:22.532: INFO @decay_lr : LR updated to `0.0004738479` 2019-11-15 00:01:22.533: INFO @log_profile : T train: 46.114967 2019-11-15 00:01:22.534: INFO @log_profile : T valid: 1.401249 2019-11-15 00:01:22.534: INFO @log_profile : T read data: 70.871789 2019-11-15 00:01:22.534: INFO @log_profile : T hooks: 168.583447 2019-11-15 00:01:22.534: INFO @main_loop : Epoch 149 done 2019-11-15 00:01:22.534: INFO @main_loop : Training epoch 150 2019-11-15 00:03:30.429: INFO @log_variables: train loss nanmean: 0.048910 2019-11-15 00:03:30.430: INFO @log_variables: train positive_distance nanmean: 0.562491 2019-11-15 00:03:30.430: INFO @log_variables: train negative_distance nanmean: 1.419269 2019-11-15 00:03:30.430: INFO @log_variables: valid loss nanmean: 0.278845 2019-11-15 00:03:30.430: INFO @log_variables: valid positive_distance nanmean: 0.663546 2019-11-15 00:03:30.430: INFO @log_variables: valid negative_distance nanmean: 1.399344 2019-11-15 00:03:30.430: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:06:01.763: INFO @metrics_hook: train matching accuracy: 0.9937970196759259, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-15 00:06:03.260: INFO @metrics_hook: valid matching accuracy: 0.9856030713447798, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:06:03.481: INFO @evaluate_embedding: best threshold 1.0314449965953827 2019-11-15 00:06:03.622: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:06:03.622: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:06:03.890: INFO @decay_lr : LR updated to `0.00047147868` 2019-11-15 00:06:03.892: INFO @log_profile : T train: 46.010857 2019-11-15 00:06:03.892: INFO @log_profile : T valid: 1.442156 2019-11-15 00:06:03.892: INFO @log_profile : T read data: 73.541935 2019-11-15 00:06:03.892: INFO @log_profile : T hooks: 160.273260 2019-11-15 00:06:03.892: INFO @main_loop : Epoch 150 done 2019-11-15 00:06:03.893: INFO @main_loop : Training epoch 151 2019-11-15 00:08:12.579: INFO @log_variables: train loss nanmean: 0.049998 2019-11-15 00:08:12.580: INFO @log_variables: train positive_distance nanmean: 0.563551 2019-11-15 00:08:12.580: INFO @log_variables: train negative_distance nanmean: 1.419256 2019-11-15 00:08:12.580: INFO @log_variables: valid loss nanmean: 0.278547 2019-11-15 00:08:12.580: INFO @log_variables: valid positive_distance nanmean: 0.663129 2019-11-15 00:08:12.580: INFO @log_variables: valid negative_distance nanmean: 1.398556 2019-11-15 00:08:12.580: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:10:48.045: INFO @metrics_hook: train matching accuracy: 0.9927119502314815, N=110592, DB_SIZE=110592, N_IDS=7304 2019-11-15 00:10:49.474: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:10:49.679: INFO @evaluate_embedding: best threshold 1.0308425724506378 2019-11-15 00:10:49.819: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:10:49.819: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:10:50.090: INFO @decay_lr : LR updated to `0.0004691213` 2019-11-15 00:10:50.092: INFO @log_profile : T train: 46.165919 2019-11-15 00:10:50.092: INFO @log_profile : T valid: 1.452771 2019-11-15 00:10:50.092: INFO @log_profile : T read data: 74.271315 2019-11-15 00:10:50.092: INFO @log_profile : T hooks: 164.210917 2019-11-15 00:10:50.092: INFO @main_loop : Epoch 151 done 2019-11-15 00:10:50.092: INFO @main_loop : Training epoch 152 2019-11-15 00:13:07.033: INFO @log_variables: train loss nanmean: 0.051321 2019-11-15 00:13:07.033: INFO @log_variables: train positive_distance nanmean: 0.562951 2019-11-15 00:13:07.033: INFO @log_variables: train negative_distance nanmean: 1.419279 2019-11-15 00:13:07.034: INFO @log_variables: valid loss nanmean: 0.279482 2019-11-15 00:13:07.034: INFO @log_variables: valid positive_distance nanmean: 0.664407 2019-11-15 00:13:07.034: INFO @log_variables: valid negative_distance nanmean: 1.398544 2019-11-15 00:13:07.034: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:15:45.126: INFO @metrics_hook: train matching accuracy: 0.9924135561342593, N=110592, DB_SIZE=110592, N_IDS=7305 2019-11-15 00:15:46.829: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:15:47.038: INFO @evaluate_embedding: best threshold 1.0314757227897644 2019-11-15 00:15:47.127: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:15:47.127: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:15:47.383: INFO @decay_lr : LR updated to `0.0004667757` 2019-11-15 00:15:47.386: INFO @log_profile : T train: 46.588578 2019-11-15 00:15:47.386: INFO @log_profile : T valid: 1.457821 2019-11-15 00:15:47.386: INFO @log_profile : T read data: 82.240243 2019-11-15 00:15:47.386: INFO @log_profile : T hooks: 166.933177 2019-11-15 00:15:47.386: INFO @main_loop : Epoch 152 done 2019-11-15 00:15:47.386: INFO @main_loop : Training epoch 153 2019-11-15 00:18:03.437: INFO @log_variables: train loss nanmean: 0.049043 2019-11-15 00:18:03.438: INFO @log_variables: train positive_distance nanmean: 0.562941 2019-11-15 00:18:03.438: INFO @log_variables: train negative_distance nanmean: 1.419290 2019-11-15 00:18:03.438: INFO @log_variables: valid loss nanmean: 0.280007 2019-11-15 00:18:03.438: INFO @log_variables: valid positive_distance nanmean: 0.666094 2019-11-15 00:18:03.438: INFO @log_variables: valid negative_distance nanmean: 1.398940 2019-11-15 00:18:03.438: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:20:38.717: INFO @metrics_hook: train matching accuracy: 0.9924497251157407, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-15 00:20:40.393: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:20:40.639: INFO @evaluate_embedding: best threshold 1.0325169265270235 2019-11-15 00:20:40.729: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:20:40.729: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:20:40.980: INFO @decay_lr : LR updated to `0.00046444184` 2019-11-15 00:20:40.982: INFO @log_profile : T train: 46.444688 2019-11-15 00:20:40.982: INFO @log_profile : T valid: 1.447605 2019-11-15 00:20:40.982: INFO @log_profile : T read data: 81.398622 2019-11-15 00:20:40.982: INFO @log_profile : T hooks: 164.227566 2019-11-15 00:20:40.983: INFO @main_loop : Epoch 153 done 2019-11-15 00:20:40.983: INFO @main_loop : Training epoch 154 2019-11-15 00:22:59.916: INFO @log_variables: train loss nanmean: 0.048535 2019-11-15 00:22:59.916: INFO @log_variables: train positive_distance nanmean: 0.561413 2019-11-15 00:22:59.916: INFO @log_variables: train negative_distance nanmean: 1.419275 2019-11-15 00:22:59.917: INFO @log_variables: valid loss nanmean: 0.274996 2019-11-15 00:22:59.917: INFO @log_variables: valid positive_distance nanmean: 0.663671 2019-11-15 00:22:59.917: INFO @log_variables: valid negative_distance nanmean: 1.399292 2019-11-15 00:22:59.917: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:25:38.951: INFO @metrics_hook: train matching accuracy: 0.9924135561342593, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 00:25:40.609: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:25:40.841: INFO @evaluate_embedding: best threshold 1.0314819514751432 2019-11-15 00:25:40.940: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:25:40.940: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:25:41.301: INFO @decay_lr : LR updated to `0.00046211964` 2019-11-15 00:25:41.303: INFO @log_profile : T train: 46.383279 2019-11-15 00:25:41.303: INFO @log_profile : T valid: 1.460970 2019-11-15 00:25:41.303: INFO @log_profile : T read data: 84.049346 2019-11-15 00:25:41.303: INFO @log_profile : T hooks: 168.345580 2019-11-15 00:25:41.303: INFO @main_loop : Epoch 154 done 2019-11-15 00:25:41.303: INFO @main_loop : Training epoch 155 2019-11-15 00:28:08.726: INFO @log_variables: train loss nanmean: 0.049812 2019-11-15 00:28:08.726: INFO @log_variables: train positive_distance nanmean: 0.562281 2019-11-15 00:28:08.726: INFO @log_variables: train negative_distance nanmean: 1.419257 2019-11-15 00:28:08.726: INFO @log_variables: valid loss nanmean: 0.275858 2019-11-15 00:28:08.727: INFO @log_variables: valid positive_distance nanmean: 0.665296 2019-11-15 00:28:08.727: INFO @log_variables: valid negative_distance nanmean: 1.399447 2019-11-15 00:28:08.727: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:30:44.236: INFO @metrics_hook: train matching accuracy: 0.9929018373842593, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 00:30:45.931: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:30:46.122: INFO @evaluate_embedding: best threshold 1.0323711037635805 2019-11-15 00:30:46.210: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:30:46.210: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:30:46.480: INFO @decay_lr : LR updated to `0.00045980903` 2019-11-15 00:30:46.482: INFO @log_profile : T train: 47.018292 2019-11-15 00:30:46.482: INFO @log_profile : T valid: 1.430260 2019-11-15 00:30:46.483: INFO @log_profile : T read data: 92.139604 2019-11-15 00:30:46.483: INFO @log_profile : T hooks: 164.510302 2019-11-15 00:30:46.483: INFO @main_loop : Epoch 155 done 2019-11-15 00:30:46.483: INFO @main_loop : Training epoch 156 2019-11-15 00:33:11.360: INFO @log_variables: train loss nanmean: 0.048139 2019-11-15 00:33:11.360: INFO @log_variables: train positive_distance nanmean: 0.561207 2019-11-15 00:33:11.360: INFO @log_variables: train negative_distance nanmean: 1.419277 2019-11-15 00:33:11.360: INFO @log_variables: valid loss nanmean: 0.275351 2019-11-15 00:33:11.360: INFO @log_variables: valid positive_distance nanmean: 0.664646 2019-11-15 00:33:11.360: INFO @log_variables: valid negative_distance nanmean: 1.399632 2019-11-15 00:33:11.360: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:35:51.318: INFO @metrics_hook: train matching accuracy: 0.9935800057870371, N=110592, DB_SIZE=110592, N_IDS=7317 2019-11-15 00:35:52.681: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:35:52.951: INFO @evaluate_embedding: best threshold 1.0321389734745026 2019-11-15 00:35:53.065: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:35:53.065: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:35:53.310: INFO @decay_lr : LR updated to `0.00045750997` 2019-11-15 00:35:53.312: INFO @log_profile : T train: 47.094645 2019-11-15 00:35:53.312: INFO @log_profile : T valid: 1.434398 2019-11-15 00:35:53.312: INFO @log_profile : T read data: 89.811981 2019-11-15 00:35:53.312: INFO @log_profile : T hooks: 168.417037 2019-11-15 00:35:53.312: INFO @main_loop : Epoch 156 done 2019-11-15 00:35:53.312: INFO @main_loop : Training epoch 157 2019-11-15 00:38:15.979: INFO @log_variables: train loss nanmean: 0.048659 2019-11-15 00:38:15.979: INFO @log_variables: train positive_distance nanmean: 0.561490 2019-11-15 00:38:15.979: INFO @log_variables: train negative_distance nanmean: 1.419283 2019-11-15 00:38:15.980: INFO @log_variables: valid loss nanmean: 0.278653 2019-11-15 00:38:15.980: INFO @log_variables: valid positive_distance nanmean: 0.665258 2019-11-15 00:38:15.980: INFO @log_variables: valid negative_distance nanmean: 1.398899 2019-11-15 00:38:15.980: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:40:56.770: INFO @metrics_hook: train matching accuracy: 0.9929018373842593, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-15 00:40:58.245: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:40:58.442: INFO @evaluate_embedding: best threshold 1.032078504562378 2019-11-15 00:40:58.531: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:40:58.531: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:40:58.798: INFO @decay_lr : LR updated to `0.0004552224` 2019-11-15 00:40:58.800: INFO @log_profile : T train: 46.325287 2019-11-15 00:40:58.800: INFO @log_profile : T valid: 1.409597 2019-11-15 00:40:58.800: INFO @log_profile : T read data: 88.303970 2019-11-15 00:40:58.800: INFO @log_profile : T hooks: 169.368173 2019-11-15 00:40:58.800: INFO @main_loop : Epoch 157 done 2019-11-15 00:40:58.800: INFO @main_loop : Training epoch 158 2019-11-15 00:43:21.985: INFO @log_variables: train loss nanmean: 0.048319 2019-11-15 00:43:21.985: INFO @log_variables: train positive_distance nanmean: 0.560532 2019-11-15 00:43:21.985: INFO @log_variables: train negative_distance nanmean: 1.419279 2019-11-15 00:43:21.985: INFO @log_variables: valid loss nanmean: 0.275269 2019-11-15 00:43:21.985: INFO @log_variables: valid positive_distance nanmean: 0.664515 2019-11-15 00:43:21.985: INFO @log_variables: valid negative_distance nanmean: 1.398499 2019-11-15 00:43:21.985: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:46:02.457: INFO @metrics_hook: train matching accuracy: 0.9932906539351852, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-15 00:46:03.919: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:46:04.207: INFO @evaluate_embedding: best threshold 1.0315069556236267 2019-11-15 00:46:04.409: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:46:04.409: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:46:04.847: INFO @decay_lr : LR updated to `0.0004529463` 2019-11-15 00:46:04.849: INFO @log_profile : T train: 46.412336 2019-11-15 00:46:04.849: INFO @log_profile : T valid: 1.442998 2019-11-15 00:46:04.849: INFO @log_profile : T read data: 88.692252 2019-11-15 00:46:04.849: INFO @log_profile : T hooks: 169.412607 2019-11-15 00:46:04.850: INFO @main_loop : Epoch 158 done 2019-11-15 00:46:04.850: INFO @main_loop : Training epoch 159 2019-11-15 00:48:33.137: INFO @log_variables: train loss nanmean: 0.049236 2019-11-15 00:48:33.138: INFO @log_variables: train positive_distance nanmean: 0.562804 2019-11-15 00:48:33.138: INFO @log_variables: train negative_distance nanmean: 1.419269 2019-11-15 00:48:33.138: INFO @log_variables: valid loss nanmean: 0.272652 2019-11-15 00:48:33.138: INFO @log_variables: valid positive_distance nanmean: 0.665448 2019-11-15 00:48:33.138: INFO @log_variables: valid negative_distance nanmean: 1.398762 2019-11-15 00:48:33.138: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:51:14.641: INFO @metrics_hook: train matching accuracy: 0.9924405461614975, N=110590, DB_SIZE=110592, N_IDS=7316 2019-11-15 00:51:16.017: INFO @metrics_hook: valid matching accuracy: 0.9878425935800362, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:51:16.224: INFO @evaluate_embedding: best threshold 1.0321047008037567 2019-11-15 00:51:16.313: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:51:16.313: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:51:16.550: INFO @decay_lr : LR updated to `0.00045068155` 2019-11-15 00:51:17.072: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-15 00:51:17.121: INFO @log_profile : T train: 46.489120 2019-11-15 00:51:17.121: INFO @log_profile : T valid: 1.430575 2019-11-15 00:51:17.121: INFO @log_profile : T read data: 93.952069 2019-11-15 00:51:17.121: INFO @log_profile : T hooks: 170.324970 2019-11-15 00:51:17.121: INFO @main_loop : Epoch 159 done 2019-11-15 00:51:17.121: INFO @main_loop : Training epoch 160 2019-11-15 00:53:44.935: INFO @log_variables: train loss nanmean: 0.049236 2019-11-15 00:53:44.936: INFO @log_variables: train positive_distance nanmean: 0.562420 2019-11-15 00:53:44.936: INFO @log_variables: train negative_distance nanmean: 1.419295 2019-11-15 00:53:44.936: INFO @log_variables: valid loss nanmean: 0.275106 2019-11-15 00:53:44.936: INFO @log_variables: valid positive_distance nanmean: 0.661767 2019-11-15 00:53:44.936: INFO @log_variables: valid negative_distance nanmean: 1.398397 2019-11-15 00:53:44.936: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 00:56:24.723: INFO @metrics_hook: train matching accuracy: 0.9930554927616171, N=110591, DB_SIZE=110592, N_IDS=7319 2019-11-15 00:56:26.123: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 00:56:26.367: INFO @evaluate_embedding: best threshold 1.0300821661949158 2019-11-15 00:56:26.491: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 00:56:26.491: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 00:56:26.849: INFO @decay_lr : LR updated to `0.00044842815` 2019-11-15 00:56:26.851: INFO @log_profile : T train: 46.490354 2019-11-15 00:56:26.851: INFO @log_profile : T valid: 1.446316 2019-11-15 00:56:26.851: INFO @log_profile : T read data: 93.593295 2019-11-15 00:56:26.851: INFO @log_profile : T hooks: 168.125964 2019-11-15 00:56:26.851: INFO @main_loop : Epoch 160 done 2019-11-15 00:56:26.851: INFO @main_loop : Training epoch 161 2019-11-15 00:59:00.330: INFO @log_variables: train loss nanmean: 0.048243 2019-11-15 00:59:00.331: INFO @log_variables: train positive_distance nanmean: 0.561693 2019-11-15 00:59:00.331: INFO @log_variables: train negative_distance nanmean: 1.419282 2019-11-15 00:59:00.331: INFO @log_variables: valid loss nanmean: 0.274758 2019-11-15 00:59:00.331: INFO @log_variables: valid positive_distance nanmean: 0.664088 2019-11-15 00:59:00.331: INFO @log_variables: valid negative_distance nanmean: 1.398208 2019-11-15 00:59:00.331: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:01:36.324: INFO @metrics_hook: train matching accuracy: 0.9923049796095523, N=110591, DB_SIZE=110592, N_IDS=7314 2019-11-15 01:01:38.091: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:01:38.329: INFO @evaluate_embedding: best threshold 1.0311483740806577 2019-11-15 01:01:38.445: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:01:38.446: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:01:38.835: INFO @decay_lr : LR updated to `0.00044618602` 2019-11-15 01:01:38.836: INFO @log_profile : T train: 46.617718 2019-11-15 01:01:38.836: INFO @log_profile : T valid: 1.425476 2019-11-15 01:01:38.836: INFO @log_profile : T read data: 98.399301 2019-11-15 01:01:38.836: INFO @log_profile : T hooks: 165.461098 2019-11-15 01:01:38.836: INFO @main_loop : Epoch 161 done 2019-11-15 01:01:38.836: INFO @main_loop : Training epoch 162 2019-11-15 01:04:11.699: INFO @log_variables: train loss nanmean: 0.047993 2019-11-15 01:04:11.699: INFO @log_variables: train positive_distance nanmean: 0.562007 2019-11-15 01:04:11.699: INFO @log_variables: train negative_distance nanmean: 1.419304 2019-11-15 01:04:11.699: INFO @log_variables: valid loss nanmean: 0.283173 2019-11-15 01:04:11.700: INFO @log_variables: valid positive_distance nanmean: 0.662981 2019-11-15 01:04:11.700: INFO @log_variables: valid negative_distance nanmean: 1.397105 2019-11-15 01:04:11.700: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:06:50.982: INFO @metrics_hook: train matching accuracy: 0.9924406828703703, N=110592, DB_SIZE=110592, N_IDS=7323 2019-11-15 01:06:52.552: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:06:52.777: INFO @evaluate_embedding: best threshold 1.0300429761409757 2019-11-15 01:06:52.859: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:06:52.859: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:06:53.175: INFO @decay_lr : LR updated to `0.0004439551` 2019-11-15 01:06:53.177: INFO @log_profile : T train: 47.505694 2019-11-15 01:06:53.177: INFO @log_profile : T valid: 1.455571 2019-11-15 01:06:53.177: INFO @log_profile : T read data: 97.312238 2019-11-15 01:06:53.177: INFO @log_profile : T hooks: 167.995891 2019-11-15 01:06:53.177: INFO @main_loop : Epoch 162 done 2019-11-15 01:06:53.177: INFO @main_loop : Training epoch 163 2019-11-15 01:09:32.516: INFO @log_variables: train loss nanmean: 0.048097 2019-11-15 01:09:32.517: INFO @log_variables: train positive_distance nanmean: 0.562267 2019-11-15 01:09:32.517: INFO @log_variables: train negative_distance nanmean: 1.419269 2019-11-15 01:09:32.517: INFO @log_variables: valid loss nanmean: 0.270515 2019-11-15 01:09:32.517: INFO @log_variables: valid positive_distance nanmean: 0.664313 2019-11-15 01:09:32.517: INFO @log_variables: valid negative_distance nanmean: 1.399007 2019-11-15 01:09:32.517: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:12:14.237: INFO @metrics_hook: train matching accuracy: 0.9923864293981481, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 01:12:15.748: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:12:15.988: INFO @evaluate_embedding: best threshold 1.031659871339798 2019-11-15 01:12:16.119: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:12:16.120: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:12:16.389: INFO @decay_lr : LR updated to `0.00044173532` 2019-11-15 01:12:16.391: INFO @log_profile : T train: 47.158274 2019-11-15 01:12:16.391: INFO @log_profile : T valid: 1.408353 2019-11-15 01:12:16.391: INFO @log_profile : T read data: 104.306488 2019-11-15 01:12:16.392: INFO @log_profile : T hooks: 170.270847 2019-11-15 01:12:16.392: INFO @main_loop : Epoch 163 done 2019-11-15 01:12:16.392: INFO @main_loop : Training epoch 164 2019-11-15 01:14:55.736: INFO @log_variables: train loss nanmean: 0.048375 2019-11-15 01:14:55.736: INFO @log_variables: train positive_distance nanmean: 0.562156 2019-11-15 01:14:55.736: INFO @log_variables: train negative_distance nanmean: 1.419292 2019-11-15 01:14:55.736: INFO @log_variables: valid loss nanmean: 0.273037 2019-11-15 01:14:55.736: INFO @log_variables: valid positive_distance nanmean: 0.665039 2019-11-15 01:14:55.737: INFO @log_variables: valid negative_distance nanmean: 1.398405 2019-11-15 01:14:55.737: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:17:38.344: INFO @metrics_hook: train matching accuracy: 0.9922597679738857, N=110591, DB_SIZE=110592, N_IDS=7315 2019-11-15 01:17:39.868: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:17:40.229: INFO @evaluate_embedding: best threshold 1.0317215621471403 2019-11-15 01:17:40.397: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:17:40.397: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:17:40.719: INFO @decay_lr : LR updated to `0.00043952663` 2019-11-15 01:17:40.720: INFO @log_profile : T train: 46.709664 2019-11-15 01:17:40.721: INFO @log_profile : T valid: 1.447801 2019-11-15 01:17:40.721: INFO @log_profile : T read data: 104.345209 2019-11-15 01:17:40.721: INFO @log_profile : T hooks: 171.755089 2019-11-15 01:17:40.721: INFO @main_loop : Epoch 164 done 2019-11-15 01:17:40.721: INFO @main_loop : Training epoch 165 2019-11-15 01:20:22.889: INFO @log_variables: train loss nanmean: 0.048678 2019-11-15 01:20:22.889: INFO @log_variables: train positive_distance nanmean: 0.562124 2019-11-15 01:20:22.889: INFO @log_variables: train negative_distance nanmean: 1.419273 2019-11-15 01:20:22.889: INFO @log_variables: valid loss nanmean: 0.272939 2019-11-15 01:20:22.889: INFO @log_variables: valid positive_distance nanmean: 0.664143 2019-11-15 01:20:22.889: INFO @log_variables: valid negative_distance nanmean: 1.399076 2019-11-15 01:20:22.890: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:23:03.588: INFO @metrics_hook: train matching accuracy: 0.9923050491898148, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 01:23:05.244: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:23:05.554: INFO @evaluate_embedding: best threshold 1.0316096544265745 2019-11-15 01:23:05.642: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:23:05.642: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:23:05.862: INFO @decay_lr : LR updated to `0.000437329` 2019-11-15 01:23:05.864: INFO @log_profile : T train: 46.887408 2019-11-15 01:23:05.864: INFO @log_profile : T valid: 1.463363 2019-11-15 01:23:05.864: INFO @log_profile : T read data: 107.058880 2019-11-15 01:23:05.864: INFO @log_profile : T hooks: 169.664267 2019-11-15 01:23:05.864: INFO @main_loop : Epoch 165 done 2019-11-15 01:23:05.864: INFO @main_loop : Training epoch 166 2019-11-15 01:25:48.295: INFO @log_variables: train loss nanmean: 0.047869 2019-11-15 01:25:48.295: INFO @log_variables: train positive_distance nanmean: 0.560502 2019-11-15 01:25:48.295: INFO @log_variables: train negative_distance nanmean: 1.419270 2019-11-15 01:25:48.295: INFO @log_variables: valid loss nanmean: 0.270402 2019-11-15 01:25:48.295: INFO @log_variables: valid positive_distance nanmean: 0.665401 2019-11-15 01:25:48.295: INFO @log_variables: valid negative_distance nanmean: 1.399387 2019-11-15 01:25:48.295: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:28:28.047: INFO @metrics_hook: train matching accuracy: 0.9927029079861112, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-15 01:28:29.573: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:28:29.814: INFO @evaluate_embedding: best threshold 1.032393962144852 2019-11-15 01:28:29.986: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:28:29.986: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:28:30.237: INFO @decay_lr : LR updated to `0.00043514234` 2019-11-15 01:28:30.238: INFO @log_profile : T train: 47.136350 2019-11-15 01:28:30.238: INFO @log_profile : T valid: 1.430973 2019-11-15 01:28:30.239: INFO @log_profile : T read data: 106.978411 2019-11-15 01:28:30.239: INFO @log_profile : T hooks: 168.754240 2019-11-15 01:28:30.239: INFO @main_loop : Epoch 166 done 2019-11-15 01:28:30.239: INFO @main_loop : Training epoch 167 2019-11-15 01:31:14.157: INFO @log_variables: train loss nanmean: 0.047993 2019-11-15 01:31:14.157: INFO @log_variables: train positive_distance nanmean: 0.560200 2019-11-15 01:31:14.157: INFO @log_variables: train negative_distance nanmean: 1.419286 2019-11-15 01:31:14.157: INFO @log_variables: valid loss nanmean: 0.276787 2019-11-15 01:31:14.157: INFO @log_variables: valid positive_distance nanmean: 0.664621 2019-11-15 01:31:14.158: INFO @log_variables: valid negative_distance nanmean: 1.398442 2019-11-15 01:31:14.158: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:33:51.984: INFO @metrics_hook: train matching accuracy: 0.9930645978009259, N=110592, DB_SIZE=110592, N_IDS=7301 2019-11-15 01:33:53.500: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:33:53.833: INFO @evaluate_embedding: best threshold 1.0315316021442413 2019-11-15 01:33:53.972: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:33:53.972: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:33:54.287: INFO @decay_lr : LR updated to `0.00043296663` 2019-11-15 01:33:54.288: INFO @log_profile : T train: 47.065607 2019-11-15 01:33:54.289: INFO @log_profile : T valid: 1.439489 2019-11-15 01:33:54.289: INFO @log_profile : T read data: 108.927535 2019-11-15 01:33:54.289: INFO @log_profile : T hooks: 166.543532 2019-11-15 01:33:54.289: INFO @main_loop : Epoch 167 done 2019-11-15 01:33:54.289: INFO @main_loop : Training epoch 168 2019-11-15 01:36:43.375: INFO @log_variables: train loss nanmean: 0.046823 2019-11-15 01:36:43.376: INFO @log_variables: train positive_distance nanmean: 0.559221 2019-11-15 01:36:43.376: INFO @log_variables: train negative_distance nanmean: 1.419300 2019-11-15 01:36:43.376: INFO @log_variables: valid loss nanmean: 0.280073 2019-11-15 01:36:43.376: INFO @log_variables: valid positive_distance nanmean: 0.667007 2019-11-15 01:36:43.376: INFO @log_variables: valid negative_distance nanmean: 1.399158 2019-11-15 01:36:43.376: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:39:25.730: INFO @metrics_hook: train matching accuracy: 0.9922778526281524, N=110591, DB_SIZE=110592, N_IDS=7312 2019-11-15 01:39:27.550: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:39:27.849: INFO @evaluate_embedding: best threshold 1.0330826640129087 2019-11-15 01:39:27.984: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:39:27.984: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:39:28.292: INFO @decay_lr : LR updated to `0.0004308018` 2019-11-15 01:39:28.294: INFO @log_profile : T train: 47.886699 2019-11-15 01:39:28.294: INFO @log_profile : T valid: 1.439002 2019-11-15 01:39:28.294: INFO @log_profile : T read data: 113.202282 2019-11-15 01:39:28.294: INFO @log_profile : T hooks: 171.404085 2019-11-15 01:39:28.294: INFO @main_loop : Epoch 168 done 2019-11-15 01:39:28.294: INFO @main_loop : Training epoch 169 2019-11-15 01:42:15.399: INFO @log_variables: train loss nanmean: 0.047559 2019-11-15 01:42:15.399: INFO @log_variables: train positive_distance nanmean: 0.561894 2019-11-15 01:42:15.399: INFO @log_variables: train negative_distance nanmean: 1.419298 2019-11-15 01:42:15.399: INFO @log_variables: valid loss nanmean: 0.274450 2019-11-15 01:42:15.400: INFO @log_variables: valid positive_distance nanmean: 0.664910 2019-11-15 01:42:15.400: INFO @log_variables: valid negative_distance nanmean: 1.399041 2019-11-15 01:42:15.400: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:44:57.545: INFO @metrics_hook: train matching accuracy: 0.9933087384259259, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 01:44:58.879: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:44:59.097: INFO @evaluate_embedding: best threshold 1.0319755375385284 2019-11-15 01:44:59.171: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:44:59.171: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:44:59.363: INFO @decay_lr : LR updated to `0.0004286478` 2019-11-15 01:44:59.365: INFO @log_profile : T train: 47.461677 2019-11-15 01:44:59.365: INFO @log_profile : T valid: 1.393317 2019-11-15 01:44:59.365: INFO @log_profile : T read data: 111.943890 2019-11-15 01:44:59.365: INFO @log_profile : T hooks: 170.199559 2019-11-15 01:44:59.365: INFO @main_loop : Epoch 169 done 2019-11-15 01:44:59.365: INFO @main_loop : Training epoch 170 2019-11-15 01:47:47.989: INFO @log_variables: train loss nanmean: 0.045666 2019-11-15 01:47:47.989: INFO @log_variables: train positive_distance nanmean: 0.559907 2019-11-15 01:47:47.990: INFO @log_variables: train negative_distance nanmean: 1.419305 2019-11-15 01:47:47.990: INFO @log_variables: valid loss nanmean: 0.273825 2019-11-15 01:47:47.990: INFO @log_variables: valid positive_distance nanmean: 0.664974 2019-11-15 01:47:47.990: INFO @log_variables: valid negative_distance nanmean: 1.398071 2019-11-15 01:47:47.990: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:50:30.449: INFO @metrics_hook: train matching accuracy: 0.9923954716435185, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 01:50:31.597: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:50:31.764: INFO @evaluate_embedding: best threshold 1.0315229296684265 2019-11-15 01:50:31.832: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:50:31.833: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:50:32.033: INFO @decay_lr : LR updated to `0.00042650456` 2019-11-15 01:50:32.034: INFO @log_profile : T train: 46.947161 2019-11-15 01:50:32.034: INFO @log_profile : T valid: 1.403716 2019-11-15 01:50:32.034: INFO @log_profile : T read data: 113.255250 2019-11-15 01:50:32.034: INFO @log_profile : T hooks: 170.994306 2019-11-15 01:50:32.034: INFO @main_loop : Epoch 170 done 2019-11-15 01:50:32.034: INFO @main_loop : Training epoch 171 2019-11-15 01:53:19.394: INFO @log_variables: train loss nanmean: 0.046993 2019-11-15 01:53:19.394: INFO @log_variables: train positive_distance nanmean: 0.560251 2019-11-15 01:53:19.394: INFO @log_variables: train negative_distance nanmean: 1.419302 2019-11-15 01:53:19.395: INFO @log_variables: valid loss nanmean: 0.272108 2019-11-15 01:53:19.395: INFO @log_variables: valid positive_distance nanmean: 0.664968 2019-11-15 01:53:19.395: INFO @log_variables: valid negative_distance nanmean: 1.399019 2019-11-15 01:53:19.395: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 01:55:58.558: INFO @metrics_hook: train matching accuracy: 0.99267578125, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 01:56:00.187: INFO @metrics_hook: valid matching accuracy: 0.9860296470086382, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 01:56:00.334: INFO @evaluate_embedding: best threshold 1.0319935381412506 2019-11-15 01:56:00.406: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 01:56:00.406: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 01:56:00.593: INFO @decay_lr : LR updated to `0.00042437203` 2019-11-15 01:56:00.594: INFO @log_profile : T train: 49.827336 2019-11-15 01:56:00.594: INFO @log_profile : T valid: 1.430759 2019-11-15 01:56:00.594: INFO @log_profile : T read data: 109.459463 2019-11-15 01:56:00.594: INFO @log_profile : T hooks: 167.770066 2019-11-15 01:56:00.594: INFO @main_loop : Epoch 171 done 2019-11-15 01:56:00.594: INFO @main_loop : Training epoch 172 2019-11-15 01:58:51.146: INFO @log_variables: train loss nanmean: 0.046460 2019-11-15 01:58:51.146: INFO @log_variables: train positive_distance nanmean: 0.560419 2019-11-15 01:58:51.146: INFO @log_variables: train negative_distance nanmean: 1.419308 2019-11-15 01:58:51.146: INFO @log_variables: valid loss nanmean: 0.271436 2019-11-15 01:58:51.146: INFO @log_variables: valid positive_distance nanmean: 0.665367 2019-11-15 01:58:51.146: INFO @log_variables: valid negative_distance nanmean: 1.399145 2019-11-15 01:58:51.146: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:01:30.108: INFO @metrics_hook: train matching accuracy: 0.9932634662856833, N=110591, DB_SIZE=110592, N_IDS=7315 2019-11-15 02:01:31.512: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:01:31.672: INFO @evaluate_embedding: best threshold 1.0322559177875519 2019-11-15 02:01:31.746: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:01:31.746: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:01:31.953: INFO @decay_lr : LR updated to `0.00042225016` 2019-11-15 02:01:31.955: INFO @log_profile : T train: 46.900481 2019-11-15 02:01:31.955: INFO @log_profile : T valid: 1.440716 2019-11-15 02:01:31.955: INFO @log_profile : T read data: 114.645600 2019-11-15 02:01:31.955: INFO @log_profile : T hooks: 168.303458 2019-11-15 02:01:31.956: INFO @main_loop : Epoch 172 done 2019-11-15 02:01:31.956: INFO @main_loop : Training epoch 173 2019-11-15 02:04:21.963: INFO @log_variables: train loss nanmean: 0.047216 2019-11-15 02:04:21.963: INFO @log_variables: train positive_distance nanmean: 0.562137 2019-11-15 02:04:21.963: INFO @log_variables: train negative_distance nanmean: 1.419301 2019-11-15 02:04:21.963: INFO @log_variables: valid loss nanmean: 0.275033 2019-11-15 02:04:21.963: INFO @log_variables: valid positive_distance nanmean: 0.665799 2019-11-15 02:04:21.963: INFO @log_variables: valid negative_distance nanmean: 1.399357 2019-11-15 02:04:21.963: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:07:00.170: INFO @metrics_hook: train matching accuracy: 0.9920970060854861, N=110591, DB_SIZE=110592, N_IDS=7321 2019-11-15 02:07:01.826: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:07:02.028: INFO @evaluate_embedding: best threshold 1.032577931880951 2019-11-15 02:07:02.127: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:07:02.128: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:07:02.375: INFO @decay_lr : LR updated to `0.0004201389` 2019-11-15 02:07:02.377: INFO @log_profile : T train: 47.169500 2019-11-15 02:07:02.378: INFO @log_profile : T valid: 1.484997 2019-11-15 02:07:02.378: INFO @log_profile : T read data: 111.102848 2019-11-15 02:07:02.378: INFO @log_profile : T hooks: 170.594826 2019-11-15 02:07:02.378: INFO @main_loop : Epoch 173 done 2019-11-15 02:07:02.378: INFO @main_loop : Training epoch 174 2019-11-15 02:09:46.331: INFO @log_variables: train loss nanmean: 0.046284 2019-11-15 02:09:46.331: INFO @log_variables: train positive_distance nanmean: 0.560887 2019-11-15 02:09:46.331: INFO @log_variables: train negative_distance nanmean: 1.419294 2019-11-15 02:09:46.331: INFO @log_variables: valid loss nanmean: 0.271498 2019-11-15 02:09:46.331: INFO @log_variables: valid positive_distance nanmean: 0.665741 2019-11-15 02:09:46.331: INFO @log_variables: valid negative_distance nanmean: 1.399618 2019-11-15 02:09:46.332: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:12:29.529: INFO @metrics_hook: train matching accuracy: 0.9924045138888888, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 02:12:31.043: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:12:31.223: INFO @evaluate_embedding: best threshold 1.0326792895793915 2019-11-15 02:12:31.313: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:12:31.313: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:12:31.564: INFO @decay_lr : LR updated to `0.00041803822` 2019-11-15 02:12:31.566: INFO @log_profile : T train: 46.915596 2019-11-15 02:12:31.566: INFO @log_profile : T valid: 1.441319 2019-11-15 02:12:31.566: INFO @log_profile : T read data: 106.643830 2019-11-15 02:12:31.566: INFO @log_profile : T hooks: 174.106704 2019-11-15 02:12:31.566: INFO @main_loop : Epoch 174 done 2019-11-15 02:12:31.566: INFO @main_loop : Training epoch 175 2019-11-15 02:15:17.555: INFO @log_variables: train loss nanmean: 0.046592 2019-11-15 02:15:17.555: INFO @log_variables: train positive_distance nanmean: 0.560583 2019-11-15 02:15:17.555: INFO @log_variables: train negative_distance nanmean: 1.419295 2019-11-15 02:15:17.555: INFO @log_variables: valid loss nanmean: 0.276081 2019-11-15 02:15:17.555: INFO @log_variables: valid positive_distance nanmean: 0.665602 2019-11-15 02:15:17.556: INFO @log_variables: valid negative_distance nanmean: 1.399219 2019-11-15 02:15:17.556: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:17:57.197: INFO @metrics_hook: train matching accuracy: 0.9916811342592593, N=110592, DB_SIZE=110592, N_IDS=7307 2019-11-15 02:17:58.545: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:17:58.725: INFO @evaluate_embedding: best threshold 1.0324104130268095 2019-11-15 02:17:58.814: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:17:58.814: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:17:59.007: INFO @decay_lr : LR updated to `0.00041594804` 2019-11-15 02:17:59.008: INFO @log_profile : T train: 46.960162 2019-11-15 02:17:59.008: INFO @log_profile : T valid: 1.488402 2019-11-15 02:17:59.008: INFO @log_profile : T read data: 108.001888 2019-11-15 02:17:59.008: INFO @log_profile : T hooks: 170.921634 2019-11-15 02:17:59.008: INFO @main_loop : Epoch 175 done 2019-11-15 02:17:59.008: INFO @main_loop : Training epoch 176 2019-11-15 02:20:37.012: INFO @log_variables: train loss nanmean: 0.046356 2019-11-15 02:20:37.013: INFO @log_variables: train positive_distance nanmean: 0.561365 2019-11-15 02:20:37.013: INFO @log_variables: train negative_distance nanmean: 1.419300 2019-11-15 02:20:37.013: INFO @log_variables: valid loss nanmean: 0.275964 2019-11-15 02:20:37.013: INFO @log_variables: valid positive_distance nanmean: 0.663312 2019-11-15 02:20:37.013: INFO @log_variables: valid negative_distance nanmean: 1.399178 2019-11-15 02:20:37.014: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:23:20.566: INFO @metrics_hook: train matching accuracy: 0.9921783163034632, N=110590, DB_SIZE=110592, N_IDS=7310 2019-11-15 02:23:22.261: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:23:22.463: INFO @evaluate_embedding: best threshold 1.0312447249889374 2019-11-15 02:23:22.544: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:23:22.544: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:23:22.774: INFO @decay_lr : LR updated to `0.0004138683` 2019-11-15 02:23:22.775: INFO @log_profile : T train: 46.378631 2019-11-15 02:23:22.775: INFO @log_profile : T valid: 1.485309 2019-11-15 02:23:22.775: INFO @log_profile : T read data: 100.683835 2019-11-15 02:23:22.775: INFO @log_profile : T hooks: 175.143016 2019-11-15 02:23:22.776: INFO @main_loop : Epoch 176 done 2019-11-15 02:23:22.776: INFO @main_loop : Training epoch 177 2019-11-15 02:26:06.298: INFO @log_variables: train loss nanmean: 0.046620 2019-11-15 02:26:06.301: INFO @log_variables: train positive_distance nanmean: 0.561096 2019-11-15 02:26:06.301: INFO @log_variables: train negative_distance nanmean: 1.419280 2019-11-15 02:26:06.301: INFO @log_variables: valid loss nanmean: 0.279140 2019-11-15 02:26:06.301: INFO @log_variables: valid positive_distance nanmean: 0.668480 2019-11-15 02:26:06.302: INFO @log_variables: valid negative_distance nanmean: 1.399773 2019-11-15 02:26:06.302: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:28:40.584: INFO @metrics_hook: train matching accuracy: 0.9924406828703703, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 02:28:41.945: INFO @metrics_hook: valid matching accuracy: 0.9854964274288152, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:28:42.147: INFO @evaluate_embedding: best threshold 1.0341264307498936 2019-11-15 02:28:42.233: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:28:42.233: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:28:42.475: INFO @decay_lr : LR updated to `0.00041179897` 2019-11-15 02:28:42.479: INFO @log_profile : T train: 46.317449 2019-11-15 02:28:42.479: INFO @log_profile : T valid: 1.497323 2019-11-15 02:28:42.479: INFO @log_profile : T read data: 105.918484 2019-11-15 02:28:42.479: INFO @log_profile : T hooks: 165.900831 2019-11-15 02:28:42.479: INFO @main_loop : Epoch 177 done 2019-11-15 02:28:42.480: INFO @main_loop : Training epoch 178 2019-11-15 02:31:32.419: INFO @log_variables: train loss nanmean: 0.045476 2019-11-15 02:31:32.419: INFO @log_variables: train positive_distance nanmean: 0.561285 2019-11-15 02:31:32.419: INFO @log_variables: train negative_distance nanmean: 1.419306 2019-11-15 02:31:32.419: INFO @log_variables: valid loss nanmean: 0.277795 2019-11-15 02:31:32.419: INFO @log_variables: valid positive_distance nanmean: 0.665004 2019-11-15 02:31:32.419: INFO @log_variables: valid negative_distance nanmean: 1.399336 2019-11-15 02:31:32.419: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:34:05.323: INFO @metrics_hook: train matching accuracy: 0.9923593026620371, N=110592, DB_SIZE=110592, N_IDS=7320 2019-11-15 02:34:06.751: INFO @metrics_hook: valid matching accuracy: 0.985816359176709, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:34:06.935: INFO @evaluate_embedding: best threshold 1.0321701169013977 2019-11-15 02:34:07.021: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:34:07.021: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:34:07.254: INFO @decay_lr : LR updated to `0.00040973997` 2019-11-15 02:34:07.257: INFO @log_profile : T train: 46.529367 2019-11-15 02:34:07.257: INFO @log_profile : T valid: 1.499895 2019-11-15 02:34:07.257: INFO @log_profile : T read data: 112.650405 2019-11-15 02:34:07.257: INFO @log_profile : T hooks: 164.025247 2019-11-15 02:34:07.257: INFO @main_loop : Epoch 178 done 2019-11-15 02:34:07.257: INFO @main_loop : Training epoch 179 2019-11-15 02:36:46.101: INFO @log_variables: train loss nanmean: 0.045701 2019-11-15 02:36:46.101: INFO @log_variables: train positive_distance nanmean: 0.560635 2019-11-15 02:36:46.101: INFO @log_variables: train negative_distance nanmean: 1.419308 2019-11-15 02:36:46.101: INFO @log_variables: valid loss nanmean: 0.275523 2019-11-15 02:36:46.101: INFO @log_variables: valid positive_distance nanmean: 0.667718 2019-11-15 02:36:46.102: INFO @log_variables: valid negative_distance nanmean: 1.399628 2019-11-15 02:36:46.102: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:39:19.492: INFO @metrics_hook: train matching accuracy: 0.9920427521226863, N=110591, DB_SIZE=110592, N_IDS=7320 2019-11-15 02:39:21.013: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:39:21.222: INFO @evaluate_embedding: best threshold 1.0336728990077975 2019-11-15 02:39:21.310: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:39:21.310: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:39:21.540: INFO @decay_lr : LR updated to `0.00040769126` 2019-11-15 02:39:21.542: INFO @log_profile : T train: 48.193336 2019-11-15 02:39:21.542: INFO @log_profile : T valid: 1.558442 2019-11-15 02:39:21.542: INFO @log_profile : T read data: 99.961731 2019-11-15 02:39:21.542: INFO @log_profile : T hooks: 164.480742 2019-11-15 02:39:21.542: INFO @main_loop : Epoch 179 done 2019-11-15 02:39:21.542: INFO @main_loop : Training epoch 180 2019-11-15 02:41:51.343: INFO @log_variables: train loss nanmean: 0.046840 2019-11-15 02:41:51.343: INFO @log_variables: train positive_distance nanmean: 0.560338 2019-11-15 02:41:51.343: INFO @log_variables: train negative_distance nanmean: 1.419282 2019-11-15 02:41:51.343: INFO @log_variables: valid loss nanmean: 0.272499 2019-11-15 02:41:51.343: INFO @log_variables: valid positive_distance nanmean: 0.668702 2019-11-15 02:41:51.343: INFO @log_variables: valid negative_distance nanmean: 1.398961 2019-11-15 02:41:51.344: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:44:21.391: INFO @metrics_hook: train matching accuracy: 0.9931459160329502, N=110591, DB_SIZE=110592, N_IDS=7308 2019-11-15 02:44:22.892: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:44:24.963: INFO @evaluate_embedding: best threshold 1.0338315367698667 2019-11-15 02:44:25.050: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:44:25.050: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:44:25.273: INFO @decay_lr : LR updated to `0.0004056528` 2019-11-15 02:44:25.275: INFO @log_profile : T train: 46.237937 2019-11-15 02:44:25.275: INFO @log_profile : T valid: 1.476984 2019-11-15 02:44:25.275: INFO @log_profile : T read data: 93.222596 2019-11-15 02:44:25.275: INFO @log_profile : T hooks: 162.721478 2019-11-15 02:44:25.275: INFO @main_loop : Epoch 180 done 2019-11-15 02:44:25.275: INFO @main_loop : Training epoch 181 2019-11-15 02:46:55.445: INFO @log_variables: train loss nanmean: 0.046273 2019-11-15 02:46:55.446: INFO @log_variables: train positive_distance nanmean: 0.560768 2019-11-15 02:46:55.446: INFO @log_variables: train negative_distance nanmean: 1.419318 2019-11-15 02:46:55.446: INFO @log_variables: valid loss nanmean: 0.282169 2019-11-15 02:46:55.446: INFO @log_variables: valid positive_distance nanmean: 0.667818 2019-11-15 02:46:55.447: INFO @log_variables: valid negative_distance nanmean: 1.398665 2019-11-15 02:46:55.447: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:49:34.451: INFO @metrics_hook: train matching accuracy: 0.9925670726744975, N=110589, DB_SIZE=110592, N_IDS=7301 2019-11-15 02:49:35.917: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:49:36.113: INFO @evaluate_embedding: best threshold 1.033241271972656 2019-11-15 02:49:36.200: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:49:36.201: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:49:36.448: INFO @decay_lr : LR updated to `0.00040362452` 2019-11-15 02:49:36.450: INFO @log_profile : T train: 46.195631 2019-11-15 02:49:36.450: INFO @log_profile : T valid: 1.481390 2019-11-15 02:49:36.450: INFO @log_profile : T read data: 93.629208 2019-11-15 02:49:36.450: INFO @log_profile : T hooks: 169.792813 2019-11-15 02:49:36.450: INFO @main_loop : Epoch 181 done 2019-11-15 02:49:36.450: INFO @main_loop : Training epoch 182 2019-11-15 02:52:00.816: INFO @log_variables: train loss nanmean: 0.045797 2019-11-15 02:52:00.818: INFO @log_variables: train positive_distance nanmean: 0.560535 2019-11-15 02:52:00.819: INFO @log_variables: train negative_distance nanmean: 1.419310 2019-11-15 02:52:00.819: INFO @log_variables: valid loss nanmean: 0.277113 2019-11-15 02:52:00.819: INFO @log_variables: valid positive_distance nanmean: 0.666332 2019-11-15 02:52:00.819: INFO @log_variables: valid negative_distance nanmean: 1.399464 2019-11-15 02:52:00.819: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:54:39.916: INFO @metrics_hook: train matching accuracy: 0.9931368737058169, N=110591, DB_SIZE=110592, N_IDS=7318 2019-11-15 02:54:41.534: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:54:41.695: INFO @evaluate_embedding: best threshold 1.032897740602493 2019-11-15 02:54:41.781: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:54:41.782: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:54:42.010: INFO @decay_lr : LR updated to `0.0004016064` 2019-11-15 02:54:42.012: INFO @log_profile : T train: 46.520530 2019-11-15 02:54:42.012: INFO @log_profile : T valid: 1.530629 2019-11-15 02:54:42.012: INFO @log_profile : T read data: 86.646797 2019-11-15 02:54:42.012: INFO @log_profile : T hooks: 170.779046 2019-11-15 02:54:42.012: INFO @main_loop : Epoch 182 done 2019-11-15 02:54:42.012: INFO @main_loop : Training epoch 183 2019-11-15 02:57:05.241: INFO @log_variables: train loss nanmean: 0.046127 2019-11-15 02:57:05.242: INFO @log_variables: train positive_distance nanmean: 0.559551 2019-11-15 02:57:05.242: INFO @log_variables: train negative_distance nanmean: 1.419325 2019-11-15 02:57:05.242: INFO @log_variables: valid loss nanmean: 0.275949 2019-11-15 02:57:05.242: INFO @log_variables: valid positive_distance nanmean: 0.668380 2019-11-15 02:57:05.242: INFO @log_variables: valid negative_distance nanmean: 1.399510 2019-11-15 02:57:05.242: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 02:59:40.047: INFO @metrics_hook: train matching accuracy: 0.9927751152907135, N=110590, DB_SIZE=110592, N_IDS=7307 2019-11-15 02:59:41.544: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 02:59:41.787: INFO @evaluate_embedding: best threshold 1.0339449644088745 2019-11-15 02:59:41.885: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 02:59:41.886: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 02:59:42.095: INFO @decay_lr : LR updated to `0.0003995984` 2019-11-15 02:59:42.097: INFO @log_profile : T train: 47.636482 2019-11-15 02:59:42.097: INFO @log_profile : T valid: 1.779350 2019-11-15 02:59:42.097: INFO @log_profile : T read data: 83.791080 2019-11-15 02:59:42.097: INFO @log_profile : T hooks: 166.805815 2019-11-15 02:59:42.097: INFO @main_loop : Epoch 183 done 2019-11-15 02:59:42.097: INFO @main_loop : Training epoch 184 2019-11-15 03:01:59.619: INFO @log_variables: train loss nanmean: 0.045665 2019-11-15 03:01:59.619: INFO @log_variables: train positive_distance nanmean: 0.560125 2019-11-15 03:01:59.619: INFO @log_variables: train negative_distance nanmean: 1.419316 2019-11-15 03:01:59.619: INFO @log_variables: valid loss nanmean: 0.270935 2019-11-15 03:01:59.619: INFO @log_variables: valid positive_distance nanmean: 0.669214 2019-11-15 03:01:59.619: INFO @log_variables: valid negative_distance nanmean: 1.399043 2019-11-15 03:01:59.619: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:04:33.117: INFO @metrics_hook: train matching accuracy: 0.9922779224537037, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 03:04:34.409: INFO @metrics_hook: valid matching accuracy: 0.9878425935800362, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:04:34.609: INFO @evaluate_embedding: best threshold 1.0341286063194275 2019-11-15 03:04:34.701: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:04:34.701: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:04:34.962: INFO @decay_lr : LR updated to `0.0003976004` 2019-11-15 03:04:34.963: INFO @log_profile : T train: 47.820624 2019-11-15 03:04:34.963: INFO @log_profile : T valid: 1.778099 2019-11-15 03:04:34.964: INFO @log_profile : T read data: 78.384758 2019-11-15 03:04:34.964: INFO @log_profile : T hooks: 164.784940 2019-11-15 03:04:34.964: INFO @main_loop : Epoch 184 done 2019-11-15 03:04:34.964: INFO @main_loop : Training epoch 185 2019-11-15 03:06:49.402: INFO @log_variables: train loss nanmean: 0.045743 2019-11-15 03:06:49.403: INFO @log_variables: train positive_distance nanmean: 0.561102 2019-11-15 03:06:49.403: INFO @log_variables: train negative_distance nanmean: 1.419302 2019-11-15 03:06:49.403: INFO @log_variables: valid loss nanmean: 0.278413 2019-11-15 03:06:49.403: INFO @log_variables: valid positive_distance nanmean: 0.667253 2019-11-15 03:06:49.403: INFO @log_variables: valid negative_distance nanmean: 1.397951 2019-11-15 03:06:49.403: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:09:27.038: INFO @metrics_hook: train matching accuracy: 0.9925400126593724, N=110590, DB_SIZE=110592, N_IDS=7315 2019-11-15 03:09:28.439: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:09:28.627: INFO @evaluate_embedding: best threshold 1.0326018929481504 2019-11-15 03:09:28.712: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:09:28.712: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:09:28.927: INFO @decay_lr : LR updated to `0.0003956124` 2019-11-15 03:09:28.929: INFO @log_profile : T train: 47.445694 2019-11-15 03:09:28.929: INFO @log_profile : T valid: 1.589154 2019-11-15 03:09:28.929: INFO @log_profile : T read data: 75.620480 2019-11-15 03:09:28.929: INFO @log_profile : T hooks: 169.236811 2019-11-15 03:09:28.929: INFO @main_loop : Epoch 185 done 2019-11-15 03:09:28.929: INFO @main_loop : Training epoch 186 2019-11-15 03:11:42.666: INFO @log_variables: train loss nanmean: 0.046105 2019-11-15 03:11:42.668: INFO @log_variables: train positive_distance nanmean: 0.559760 2019-11-15 03:11:42.668: INFO @log_variables: train negative_distance nanmean: 1.419298 2019-11-15 03:11:42.668: INFO @log_variables: valid loss nanmean: 0.272650 2019-11-15 03:11:42.668: INFO @log_variables: valid positive_distance nanmean: 0.669966 2019-11-15 03:11:42.668: INFO @log_variables: valid negative_distance nanmean: 1.398746 2019-11-15 03:11:42.669: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:14:10.650: INFO @metrics_hook: train matching accuracy: 0.9927390113119512, N=110591, DB_SIZE=110592, N_IDS=7310 2019-11-15 03:14:12.083: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:14:12.286: INFO @evaluate_embedding: best threshold 1.0343562960624697 2019-11-15 03:14:12.394: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:14:12.394: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:14:12.587: INFO @decay_lr : LR updated to `0.00039363434` 2019-11-15 03:14:12.588: INFO @log_profile : T train: 47.279232 2019-11-15 03:14:12.588: INFO @log_profile : T valid: 1.523189 2019-11-15 03:14:12.588: INFO @log_profile : T read data: 74.790255 2019-11-15 03:14:12.589: INFO @log_profile : T hooks: 159.987726 2019-11-15 03:14:12.589: INFO @main_loop : Epoch 186 done 2019-11-15 03:14:12.589: INFO @main_loop : Training epoch 187 2019-11-15 03:16:16.621: INFO @log_variables: train loss nanmean: 0.045165 2019-11-15 03:16:16.621: INFO @log_variables: train positive_distance nanmean: 0.560658 2019-11-15 03:16:16.621: INFO @log_variables: train negative_distance nanmean: 1.419323 2019-11-15 03:16:16.621: INFO @log_variables: valid loss nanmean: 0.272728 2019-11-15 03:16:16.621: INFO @log_variables: valid positive_distance nanmean: 0.670262 2019-11-15 03:16:16.621: INFO @log_variables: valid negative_distance nanmean: 1.399559 2019-11-15 03:16:16.621: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:18:51.525: INFO @metrics_hook: train matching accuracy: 0.9930464504344838, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-15 03:18:52.804: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:18:53.021: INFO @evaluate_embedding: best threshold 1.0349102914333344 2019-11-15 03:18:53.109: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:18:53.109: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:18:53.342: INFO @decay_lr : LR updated to `0.00039166617` 2019-11-15 03:18:53.343: INFO @log_profile : T train: 47.147044 2019-11-15 03:18:53.344: INFO @log_profile : T valid: 1.830141 2019-11-15 03:18:53.344: INFO @log_profile : T read data: 64.667082 2019-11-15 03:18:53.344: INFO @log_profile : T hooks: 167.004948 2019-11-15 03:18:53.344: INFO @main_loop : Epoch 187 done 2019-11-15 03:18:53.344: INFO @main_loop : Training epoch 188 2019-11-15 03:20:58.982: INFO @log_variables: train loss nanmean: 0.044362 2019-11-15 03:20:59.000: INFO @log_variables: train positive_distance nanmean: 0.559899 2019-11-15 03:20:59.000: INFO @log_variables: train negative_distance nanmean: 1.419310 2019-11-15 03:20:59.000: INFO @log_variables: valid loss nanmean: 0.273467 2019-11-15 03:20:59.001: INFO @log_variables: valid positive_distance nanmean: 0.667270 2019-11-15 03:20:59.001: INFO @log_variables: valid negative_distance nanmean: 1.399077 2019-11-15 03:20:59.001: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:23:32.120: INFO @metrics_hook: train matching accuracy: 0.9927029079861112, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-15 03:23:33.263: INFO @metrics_hook: valid matching accuracy: 0.9878425935800362, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:23:33.461: INFO @evaluate_embedding: best threshold 1.0331735014915464 2019-11-15 03:23:33.546: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:23:33.546: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:23:33.772: INFO @decay_lr : LR updated to `0.00038970783` 2019-11-15 03:23:33.774: INFO @log_profile : T train: 47.160818 2019-11-15 03:23:33.774: INFO @log_profile : T valid: 1.781054 2019-11-15 03:23:33.774: INFO @log_profile : T read data: 67.570077 2019-11-15 03:23:33.774: INFO @log_profile : T hooks: 163.842367 2019-11-15 03:23:33.774: INFO @main_loop : Epoch 188 done 2019-11-15 03:23:33.774: INFO @main_loop : Training epoch 189 2019-11-15 03:25:30.835: INFO @log_variables: train loss nanmean: 0.045039 2019-11-15 03:25:30.838: INFO @log_variables: train positive_distance nanmean: 0.560058 2019-11-15 03:25:30.838: INFO @log_variables: train negative_distance nanmean: 1.419307 2019-11-15 03:25:30.839: INFO @log_variables: valid loss nanmean: 0.272590 2019-11-15 03:25:30.839: INFO @log_variables: valid positive_distance nanmean: 0.668171 2019-11-15 03:25:30.839: INFO @log_variables: valid negative_distance nanmean: 1.399272 2019-11-15 03:25:30.839: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:28:03.516: INFO @metrics_hook: train matching accuracy: 0.9928385416666666, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 03:28:04.778: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:28:04.981: INFO @evaluate_embedding: best threshold 1.0337216556072235 2019-11-15 03:28:05.068: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:28:05.068: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:28:05.326: INFO @decay_lr : LR updated to `0.0003877593` 2019-11-15 03:28:05.329: INFO @log_profile : T train: 45.765663 2019-11-15 03:28:05.329: INFO @log_profile : T valid: 1.396300 2019-11-15 03:28:05.329: INFO @log_profile : T read data: 63.857492 2019-11-15 03:28:05.329: INFO @log_profile : T hooks: 160.451184 2019-11-15 03:28:05.329: INFO @main_loop : Epoch 189 done 2019-11-15 03:28:05.329: INFO @main_loop : Training epoch 190 2019-11-15 03:30:07.075: INFO @log_variables: train loss nanmean: 0.045105 2019-11-15 03:30:07.076: INFO @log_variables: train positive_distance nanmean: 0.560553 2019-11-15 03:30:07.076: INFO @log_variables: train negative_distance nanmean: 1.419292 2019-11-15 03:30:07.076: INFO @log_variables: valid loss nanmean: 0.279764 2019-11-15 03:30:07.076: INFO @log_variables: valid positive_distance nanmean: 0.667982 2019-11-15 03:30:07.076: INFO @log_variables: valid negative_distance nanmean: 1.398327 2019-11-15 03:30:07.076: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:32:33.078: INFO @metrics_hook: train matching accuracy: 0.9933358049027498, N=110591, DB_SIZE=110592, N_IDS=7303 2019-11-15 03:32:34.308: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:32:34.664: INFO @evaluate_embedding: best threshold 1.0331540703773499 2019-11-15 03:32:34.814: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:32:34.815: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:32:35.229: INFO @decay_lr : LR updated to `0.0003858205` 2019-11-15 03:32:35.230: INFO @log_profile : T train: 45.386603 2019-11-15 03:32:35.231: INFO @log_profile : T valid: 1.399254 2019-11-15 03:32:35.231: INFO @log_profile : T read data: 68.895233 2019-11-15 03:32:35.231: INFO @log_profile : T hooks: 154.142986 2019-11-15 03:32:35.231: INFO @main_loop : Epoch 190 done 2019-11-15 03:32:35.231: INFO @main_loop : Training epoch 191 2019-11-15 03:34:40.235: INFO @log_variables: train loss nanmean: 0.044930 2019-11-15 03:34:40.236: INFO @log_variables: train positive_distance nanmean: 0.560373 2019-11-15 03:34:40.236: INFO @log_variables: train negative_distance nanmean: 1.419305 2019-11-15 03:34:40.236: INFO @log_variables: valid loss nanmean: 0.275268 2019-11-15 03:34:40.236: INFO @log_variables: valid positive_distance nanmean: 0.667817 2019-11-15 03:34:40.236: INFO @log_variables: valid negative_distance nanmean: 1.399698 2019-11-15 03:34:40.236: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:37:12.021: INFO @metrics_hook: train matching accuracy: 0.9926486545138888, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-15 03:37:13.296: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:37:13.675: INFO @evaluate_embedding: best threshold 1.033757507801056 2019-11-15 03:37:13.820: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:37:13.820: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:37:14.350: INFO @decay_lr : LR updated to `0.0003838914` 2019-11-15 03:37:14.354: INFO @log_profile : T train: 47.825010 2019-11-15 03:37:14.354: INFO @log_profile : T valid: 1.574891 2019-11-15 03:37:14.354: INFO @log_profile : T read data: 69.163437 2019-11-15 03:37:14.354: INFO @log_profile : T hooks: 160.478296 2019-11-15 03:37:14.354: INFO @main_loop : Epoch 191 done 2019-11-15 03:37:14.355: INFO @main_loop : Training epoch 192 2019-11-15 03:39:27.414: INFO @log_variables: train loss nanmean: 0.045141 2019-11-15 03:39:27.415: INFO @log_variables: train positive_distance nanmean: 0.561235 2019-11-15 03:39:27.415: INFO @log_variables: train negative_distance nanmean: 1.419294 2019-11-15 03:39:27.415: INFO @log_variables: valid loss nanmean: 0.273491 2019-11-15 03:39:27.415: INFO @log_variables: valid positive_distance nanmean: 0.666761 2019-11-15 03:39:27.415: INFO @log_variables: valid negative_distance nanmean: 1.399059 2019-11-15 03:39:27.415: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:41:57.019: INFO @metrics_hook: train matching accuracy: 0.9925491224421518, N=110591, DB_SIZE=110592, N_IDS=7315 2019-11-15 03:41:58.408: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:41:58.748: INFO @evaluate_embedding: best threshold 1.032909631729126 2019-11-15 03:41:58.920: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:41:58.921: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:41:59.326: INFO @decay_lr : LR updated to `0.00038197194` 2019-11-15 03:41:59.328: INFO @log_profile : T train: 48.004501 2019-11-15 03:41:59.328: INFO @log_profile : T valid: 1.640720 2019-11-15 03:41:59.328: INFO @log_profile : T read data: 76.552384 2019-11-15 03:41:59.328: INFO @log_profile : T hooks: 158.701411 2019-11-15 03:41:59.328: INFO @main_loop : Epoch 192 done 2019-11-15 03:41:59.328: INFO @main_loop : Training epoch 193 2019-11-15 03:44:08.497: INFO @log_variables: train loss nanmean: 0.045133 2019-11-15 03:44:08.501: INFO @log_variables: train positive_distance nanmean: 0.559752 2019-11-15 03:44:08.501: INFO @log_variables: train negative_distance nanmean: 1.419304 2019-11-15 03:44:08.502: INFO @log_variables: valid loss nanmean: 0.275396 2019-11-15 03:44:08.502: INFO @log_variables: valid positive_distance nanmean: 0.669488 2019-11-15 03:44:08.502: INFO @log_variables: valid negative_distance nanmean: 1.398886 2019-11-15 03:44:08.502: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:46:33.457: INFO @metrics_hook: train matching accuracy: 0.9933991608796297, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-15 03:46:34.768: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:46:35.171: INFO @evaluate_embedding: best threshold 1.0341868698596957 2019-11-15 03:46:35.317: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:46:35.317: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:46:35.779: INFO @decay_lr : LR updated to `0.0003800621` 2019-11-15 03:46:35.781: INFO @log_profile : T train: 47.384364 2019-11-15 03:46:35.781: INFO @log_profile : T valid: 1.424863 2019-11-15 03:46:35.781: INFO @log_profile : T read data: 73.857070 2019-11-15 03:46:35.781: INFO @log_profile : T hooks: 153.701200 2019-11-15 03:46:35.781: INFO @main_loop : Epoch 193 done 2019-11-15 03:46:35.781: INFO @main_loop : Training epoch 194 2019-11-15 03:48:50.573: INFO @log_variables: train loss nanmean: 0.045185 2019-11-15 03:48:50.573: INFO @log_variables: train positive_distance nanmean: 0.560983 2019-11-15 03:48:50.573: INFO @log_variables: train negative_distance nanmean: 1.419317 2019-11-15 03:48:50.573: INFO @log_variables: valid loss nanmean: 0.274705 2019-11-15 03:48:50.573: INFO @log_variables: valid positive_distance nanmean: 0.670132 2019-11-15 03:48:50.573: INFO @log_variables: valid negative_distance nanmean: 1.400462 2019-11-15 03:48:50.574: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:51:23.073: INFO @metrics_hook: train matching accuracy: 0.9923050491898148, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 03:51:24.243: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:51:24.531: INFO @evaluate_embedding: best threshold 1.0352968871593473 2019-11-15 03:51:24.655: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:51:24.661: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:51:25.061: INFO @decay_lr : LR updated to `0.00037816179` 2019-11-15 03:51:25.063: INFO @log_profile : T train: 46.885308 2019-11-15 03:51:25.063: INFO @log_profile : T valid: 1.451205 2019-11-15 03:51:25.063: INFO @log_profile : T read data: 79.666772 2019-11-15 03:51:25.063: INFO @log_profile : T hooks: 161.200075 2019-11-15 03:51:25.063: INFO @main_loop : Epoch 194 done 2019-11-15 03:51:25.063: INFO @main_loop : Training epoch 195 2019-11-15 03:53:39.666: INFO @log_variables: train loss nanmean: 0.045354 2019-11-15 03:53:39.670: INFO @log_variables: train positive_distance nanmean: 0.559770 2019-11-15 03:53:39.670: INFO @log_variables: train negative_distance nanmean: 1.419310 2019-11-15 03:53:39.670: INFO @log_variables: valid loss nanmean: 0.272164 2019-11-15 03:53:39.670: INFO @log_variables: valid positive_distance nanmean: 0.669064 2019-11-15 03:53:39.670: INFO @log_variables: valid negative_distance nanmean: 1.399128 2019-11-15 03:53:39.670: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 03:56:15.859: INFO @metrics_hook: train matching accuracy: 0.992820392256151, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-15 03:56:17.189: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 03:56:17.519: INFO @evaluate_embedding: best threshold 1.034096121788025 2019-11-15 03:56:17.676: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 03:56:17.676: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 03:56:18.052: INFO @decay_lr : LR updated to `0.00037627097` 2019-11-15 03:56:18.056: INFO @log_profile : T train: 48.165202 2019-11-15 03:56:18.056: INFO @log_profile : T valid: 1.616456 2019-11-15 03:56:18.056: INFO @log_profile : T read data: 77.981429 2019-11-15 03:56:18.056: INFO @log_profile : T hooks: 165.154471 2019-11-15 03:56:18.056: INFO @main_loop : Epoch 195 done 2019-11-15 03:56:18.057: INFO @main_loop : Training epoch 196 2019-11-15 03:58:34.782: INFO @log_variables: train loss nanmean: 0.044733 2019-11-15 03:58:34.787: INFO @log_variables: train positive_distance nanmean: 0.560358 2019-11-15 03:58:34.787: INFO @log_variables: train negative_distance nanmean: 1.419306 2019-11-15 03:58:34.787: INFO @log_variables: valid loss nanmean: 0.270927 2019-11-15 03:58:34.787: INFO @log_variables: valid positive_distance nanmean: 0.666488 2019-11-15 03:58:34.787: INFO @log_variables: valid negative_distance nanmean: 1.399753 2019-11-15 03:58:34.787: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:01:05.947: INFO @metrics_hook: train matching accuracy: 0.9923954716435185, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 04:01:07.292: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:01:07.641: INFO @evaluate_embedding: best threshold 1.033120781183243 2019-11-15 04:01:07.771: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:01:07.772: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:01:08.196: INFO @decay_lr : LR updated to `0.0003743896` 2019-11-15 04:01:08.198: INFO @log_profile : T train: 47.969509 2019-11-15 04:01:08.198: INFO @log_profile : T valid: 1.618585 2019-11-15 04:01:08.198: INFO @log_profile : T read data: 80.327394 2019-11-15 04:01:08.198: INFO @log_profile : T hooks: 160.143724 2019-11-15 04:01:08.198: INFO @main_loop : Epoch 196 done 2019-11-15 04:01:08.198: INFO @main_loop : Training epoch 197 2019-11-15 04:03:23.786: INFO @log_variables: train loss nanmean: 0.043451 2019-11-15 04:03:23.787: INFO @log_variables: train positive_distance nanmean: 0.559388 2019-11-15 04:03:23.787: INFO @log_variables: train negative_distance nanmean: 1.419335 2019-11-15 04:03:23.787: INFO @log_variables: valid loss nanmean: 0.272935 2019-11-15 04:03:23.787: INFO @log_variables: valid positive_distance nanmean: 0.667512 2019-11-15 04:03:23.788: INFO @log_variables: valid negative_distance nanmean: 1.399926 2019-11-15 04:03:23.788: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:05:59.132: INFO @metrics_hook: train matching accuracy: 0.9924586991708186, N=110591, DB_SIZE=110592, N_IDS=7316 2019-11-15 04:06:00.340: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:06:00.666: INFO @evaluate_embedding: best threshold 1.033719003200531 2019-11-15 04:06:00.840: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:06:00.841: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:06:01.471: INFO @decay_lr : LR updated to `0.00037251765` 2019-11-15 04:06:01.475: INFO @log_profile : T train: 48.005631 2019-11-15 04:06:01.475: INFO @log_profile : T valid: 1.616323 2019-11-15 04:06:01.475: INFO @log_profile : T read data: 79.021603 2019-11-15 04:06:01.475: INFO @log_profile : T hooks: 164.554364 2019-11-15 04:06:01.475: INFO @main_loop : Epoch 197 done 2019-11-15 04:06:01.475: INFO @main_loop : Training epoch 198 2019-11-15 04:08:13.351: INFO @log_variables: train loss nanmean: 0.044514 2019-11-15 04:08:13.356: INFO @log_variables: train positive_distance nanmean: 0.559699 2019-11-15 04:08:13.356: INFO @log_variables: train negative_distance nanmean: 1.419323 2019-11-15 04:08:13.356: INFO @log_variables: valid loss nanmean: 0.269906 2019-11-15 04:08:13.356: INFO @log_variables: valid positive_distance nanmean: 0.668154 2019-11-15 04:08:13.356: INFO @log_variables: valid negative_distance nanmean: 1.399585 2019-11-15 04:08:13.356: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:10:48.801: INFO @metrics_hook: train matching accuracy: 0.9928203273352021, N=110590, DB_SIZE=110592, N_IDS=7313 2019-11-15 04:10:50.487: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:10:50.827: INFO @evaluate_embedding: best threshold 1.0338693261146545 2019-11-15 04:10:50.974: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:10:50.974: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:10:51.195: INFO @decay_lr : LR updated to `0.00037065506` 2019-11-15 04:10:51.197: INFO @log_profile : T train: 45.982044 2019-11-15 04:10:51.197: INFO @log_profile : T valid: 1.424689 2019-11-15 04:10:51.197: INFO @log_profile : T read data: 77.800922 2019-11-15 04:10:51.197: INFO @log_profile : T hooks: 164.433941 2019-11-15 04:10:51.197: INFO @main_loop : Epoch 198 done 2019-11-15 04:10:51.197: INFO @main_loop : Training epoch 199 2019-11-15 04:13:21.293: INFO @log_variables: train loss nanmean: 0.043461 2019-11-15 04:13:21.293: INFO @log_variables: train positive_distance nanmean: 0.560054 2019-11-15 04:13:21.293: INFO @log_variables: train negative_distance nanmean: 1.419332 2019-11-15 04:13:21.293: INFO @log_variables: valid loss nanmean: 0.269318 2019-11-15 04:13:21.293: INFO @log_variables: valid positive_distance nanmean: 0.668589 2019-11-15 04:13:21.293: INFO @log_variables: valid negative_distance nanmean: 1.398895 2019-11-15 04:13:21.293: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:15:58.812: INFO @metrics_hook: train matching accuracy: 0.9928294994212963, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-15 04:16:00.269: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:16:00.594: INFO @evaluate_embedding: best threshold 1.0337418317794798 2019-11-15 04:16:00.751: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:16:00.751: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:16:01.056: INFO @decay_lr : LR updated to `0.0003688018` 2019-11-15 04:16:01.058: INFO @log_profile : T train: 85.454203 2019-11-15 04:16:01.058: INFO @log_profile : T valid: 1.560342 2019-11-15 04:16:01.058: INFO @log_profile : T read data: 56.834828 2019-11-15 04:16:01.058: INFO @log_profile : T hooks: 165.921856 2019-11-15 04:16:01.058: INFO @main_loop : Epoch 199 done 2019-11-15 04:16:01.058: INFO @main_loop : Training epoch 200 2019-11-15 04:18:05.284: INFO @log_variables: train loss nanmean: 0.043769 2019-11-15 04:18:05.285: INFO @log_variables: train positive_distance nanmean: 0.559861 2019-11-15 04:18:05.285: INFO @log_variables: train negative_distance nanmean: 1.419298 2019-11-15 04:18:05.285: INFO @log_variables: valid loss nanmean: 0.271511 2019-11-15 04:18:05.285: INFO @log_variables: valid positive_distance nanmean: 0.670955 2019-11-15 04:18:05.285: INFO @log_variables: valid negative_distance nanmean: 1.399803 2019-11-15 04:18:05.285: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:20:35.603: INFO @metrics_hook: train matching accuracy: 0.9923140914351852, N=110592, DB_SIZE=110592, N_IDS=7320 2019-11-15 04:20:36.904: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:20:37.201: INFO @evaluate_embedding: best threshold 1.035378843545914 2019-11-15 04:20:37.367: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:20:37.367: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:20:37.719: INFO @decay_lr : LR updated to `0.00036695777` 2019-11-15 04:20:37.721: INFO @log_profile : T train: 47.944661 2019-11-15 04:20:37.721: INFO @log_profile : T valid: 1.559671 2019-11-15 04:20:37.721: INFO @log_profile : T read data: 68.046899 2019-11-15 04:20:37.721: INFO @log_profile : T hooks: 159.028435 2019-11-15 04:20:37.721: INFO @main_loop : Epoch 200 done 2019-11-15 04:20:37.721: INFO @main_loop : Training epoch 201 2019-11-15 04:22:48.047: INFO @log_variables: train loss nanmean: 0.044597 2019-11-15 04:22:48.048: INFO @log_variables: train positive_distance nanmean: 0.560316 2019-11-15 04:22:48.048: INFO @log_variables: train negative_distance nanmean: 1.419320 2019-11-15 04:22:48.048: INFO @log_variables: valid loss nanmean: 0.273058 2019-11-15 04:22:48.048: INFO @log_variables: valid positive_distance nanmean: 0.669044 2019-11-15 04:22:48.049: INFO @log_variables: valid negative_distance nanmean: 1.399303 2019-11-15 04:22:48.049: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:25:19.216: INFO @metrics_hook: train matching accuracy: 0.9925220630787037, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 04:25:20.524: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:25:20.879: INFO @evaluate_embedding: best threshold 1.0341734290122986 2019-11-15 04:25:21.058: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:25:21.059: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:25:21.285: INFO @decay_lr : LR updated to `0.00036512298` 2019-11-15 04:25:21.287: INFO @log_profile : T train: 45.924000 2019-11-15 04:25:21.287: INFO @log_profile : T valid: 1.432689 2019-11-15 04:25:21.287: INFO @log_profile : T read data: 76.201374 2019-11-15 04:25:21.287: INFO @log_profile : T hooks: 159.924251 2019-11-15 04:25:21.287: INFO @main_loop : Epoch 201 done 2019-11-15 04:25:21.287: INFO @main_loop : Training epoch 202 2019-11-15 04:27:36.977: INFO @log_variables: train loss nanmean: 0.043697 2019-11-15 04:27:36.979: INFO @log_variables: train positive_distance nanmean: 0.559174 2019-11-15 04:27:36.979: INFO @log_variables: train negative_distance nanmean: 1.419314 2019-11-15 04:27:36.979: INFO @log_variables: valid loss nanmean: 0.276042 2019-11-15 04:27:36.979: INFO @log_variables: valid positive_distance nanmean: 0.668404 2019-11-15 04:27:36.980: INFO @log_variables: valid negative_distance nanmean: 1.399178 2019-11-15 04:27:36.980: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:30:09.864: INFO @metrics_hook: train matching accuracy: 0.9926305033863515, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-15 04:30:11.346: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:30:11.722: INFO @evaluate_embedding: best threshold 1.0337909758090973 2019-11-15 04:30:11.881: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:30:11.882: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:30:12.232: INFO @decay_lr : LR updated to `0.00036329735` 2019-11-15 04:30:12.234: INFO @log_profile : T train: 54.956395 2019-11-15 04:30:12.234: INFO @log_profile : T valid: 5.372391 2019-11-15 04:30:12.234: INFO @log_profile : T read data: 69.008619 2019-11-15 04:30:12.234: INFO @log_profile : T hooks: 161.528511 2019-11-15 04:30:12.234: INFO @main_loop : Epoch 202 done 2019-11-15 04:30:12.234: INFO @main_loop : Training epoch 203 2019-11-15 04:32:34.040: INFO @log_variables: train loss nanmean: 0.043919 2019-11-15 04:32:34.041: INFO @log_variables: train positive_distance nanmean: 0.560020 2019-11-15 04:32:34.041: INFO @log_variables: train negative_distance nanmean: 1.419335 2019-11-15 04:32:34.041: INFO @log_variables: valid loss nanmean: 0.274172 2019-11-15 04:32:34.041: INFO @log_variables: valid positive_distance nanmean: 0.668813 2019-11-15 04:32:34.041: INFO @log_variables: valid negative_distance nanmean: 1.399506 2019-11-15 04:32:34.041: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:35:09.443: INFO @metrics_hook: train matching accuracy: 0.9921875, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 04:35:11.004: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:35:11.377: INFO @evaluate_embedding: best threshold 1.034159868955612 2019-11-15 04:35:11.505: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:35:11.505: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:35:11.826: INFO @decay_lr : LR updated to `0.00036148087` 2019-11-15 04:35:11.829: INFO @log_profile : T train: 88.296967 2019-11-15 04:35:11.829: INFO @log_profile : T valid: 1.568222 2019-11-15 04:35:11.829: INFO @log_profile : T read data: 45.755616 2019-11-15 04:35:11.829: INFO @log_profile : T hooks: 163.894183 2019-11-15 04:35:11.830: INFO @main_loop : Epoch 203 done 2019-11-15 04:35:11.830: INFO @main_loop : Training epoch 204 2019-11-15 04:37:26.098: INFO @log_variables: train loss nanmean: 0.043320 2019-11-15 04:37:26.099: INFO @log_variables: train positive_distance nanmean: 0.558613 2019-11-15 04:37:26.099: INFO @log_variables: train negative_distance nanmean: 1.419325 2019-11-15 04:37:26.099: INFO @log_variables: valid loss nanmean: 0.276588 2019-11-15 04:37:26.099: INFO @log_variables: valid positive_distance nanmean: 0.666881 2019-11-15 04:37:26.099: INFO @log_variables: valid negative_distance nanmean: 1.399538 2019-11-15 04:37:26.099: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:40:03.029: INFO @metrics_hook: train matching accuracy: 0.9927842229476178, N=110591, DB_SIZE=110592, N_IDS=7320 2019-11-15 04:40:04.496: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:40:04.717: INFO @evaluate_embedding: best threshold 1.0332091152667997 2019-11-15 04:40:04.809: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:40:04.809: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:40:05.044: INFO @decay_lr : LR updated to `0.00035967346` 2019-11-15 04:40:05.045: INFO @log_profile : T train: 85.655881 2019-11-15 04:40:05.045: INFO @log_profile : T valid: 1.431472 2019-11-15 04:40:05.045: INFO @log_profile : T read data: 40.220259 2019-11-15 04:40:05.046: INFO @log_profile : T hooks: 165.827857 2019-11-15 04:40:05.046: INFO @main_loop : Epoch 204 done 2019-11-15 04:40:05.046: INFO @main_loop : Training epoch 205 2019-11-15 04:42:10.358: INFO @log_variables: train loss nanmean: 0.043896 2019-11-15 04:42:10.359: INFO @log_variables: train positive_distance nanmean: 0.559675 2019-11-15 04:42:10.359: INFO @log_variables: train negative_distance nanmean: 1.419324 2019-11-15 04:42:10.359: INFO @log_variables: valid loss nanmean: 0.272781 2019-11-15 04:42:10.359: INFO @log_variables: valid positive_distance nanmean: 0.665522 2019-11-15 04:42:10.359: INFO @log_variables: valid negative_distance nanmean: 1.399474 2019-11-15 04:42:10.359: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:44:48.572: INFO @metrics_hook: train matching accuracy: 0.9915452712295074, N=110589, DB_SIZE=110592, N_IDS=7311 2019-11-15 04:44:50.018: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:44:50.224: INFO @evaluate_embedding: best threshold 1.0324978828430176 2019-11-15 04:44:50.308: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:44:50.308: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:44:50.517: INFO @decay_lr : LR updated to `0.0003578751` 2019-11-15 04:44:50.519: INFO @log_profile : T train: 59.123207 2019-11-15 04:44:50.519: INFO @log_profile : T valid: 1.367448 2019-11-15 04:44:50.519: INFO @log_profile : T read data: 59.047662 2019-11-15 04:44:50.519: INFO @log_profile : T hooks: 165.853547 2019-11-15 04:44:50.519: INFO @main_loop : Epoch 205 done 2019-11-15 04:44:50.520: INFO @main_loop : Training epoch 206 2019-11-15 04:47:04.041: INFO @log_variables: train loss nanmean: 0.043427 2019-11-15 04:47:04.041: INFO @log_variables: train positive_distance nanmean: 0.559132 2019-11-15 04:47:04.041: INFO @log_variables: train negative_distance nanmean: 1.419296 2019-11-15 04:47:04.042: INFO @log_variables: valid loss nanmean: 0.276169 2019-11-15 04:47:04.042: INFO @log_variables: valid positive_distance nanmean: 0.667887 2019-11-15 04:47:04.042: INFO @log_variables: valid negative_distance nanmean: 1.399011 2019-11-15 04:47:04.042: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:49:45.310: INFO @metrics_hook: train matching accuracy: 0.9923231336805556, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 04:49:46.750: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:49:46.958: INFO @evaluate_embedding: best threshold 1.033449113368988 2019-11-15 04:49:47.058: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:49:47.058: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:49:47.328: INFO @decay_lr : LR updated to `0.00035608574` 2019-11-15 04:49:47.330: INFO @log_profile : T train: 94.980692 2019-11-15 04:49:47.330: INFO @log_profile : T valid: 1.587897 2019-11-15 04:49:47.330: INFO @log_profile : T read data: 28.964459 2019-11-15 04:49:47.330: INFO @log_profile : T hooks: 171.185890 2019-11-15 04:49:47.330: INFO @main_loop : Epoch 206 done 2019-11-15 04:49:47.330: INFO @main_loop : Training epoch 207 2019-11-15 04:51:51.618: INFO @log_variables: train loss nanmean: 0.042678 2019-11-15 04:51:51.618: INFO @log_variables: train positive_distance nanmean: 0.559604 2019-11-15 04:51:51.619: INFO @log_variables: train negative_distance nanmean: 1.419335 2019-11-15 04:51:51.619: INFO @log_variables: valid loss nanmean: 0.272167 2019-11-15 04:51:51.619: INFO @log_variables: valid positive_distance nanmean: 0.669418 2019-11-15 04:51:51.619: INFO @log_variables: valid negative_distance nanmean: 1.399959 2019-11-15 04:51:51.619: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:54:25.881: INFO @metrics_hook: train matching accuracy: 0.9927752459490741, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-15 04:54:27.412: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:54:27.617: INFO @evaluate_embedding: best threshold 1.034688889980316 2019-11-15 04:54:27.710: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:54:27.711: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:54:27.934: INFO @decay_lr : LR updated to `0.00035430532` 2019-11-15 04:54:27.936: INFO @log_profile : T train: 46.300287 2019-11-15 04:54:27.936: INFO @log_profile : T valid: 1.397411 2019-11-15 04:54:27.936: INFO @log_profile : T read data: 69.886237 2019-11-15 04:54:27.936: INFO @log_profile : T hooks: 162.939614 2019-11-15 04:54:27.936: INFO @main_loop : Epoch 207 done 2019-11-15 04:54:27.937: INFO @main_loop : Training epoch 208 2019-11-15 04:56:28.062: INFO @log_variables: train loss nanmean: 0.043070 2019-11-15 04:56:28.063: INFO @log_variables: train positive_distance nanmean: 0.559488 2019-11-15 04:56:28.063: INFO @log_variables: train negative_distance nanmean: 1.419346 2019-11-15 04:56:28.063: INFO @log_variables: valid loss nanmean: 0.274779 2019-11-15 04:56:28.063: INFO @log_variables: valid positive_distance nanmean: 0.667537 2019-11-15 04:56:28.063: INFO @log_variables: valid negative_distance nanmean: 1.399012 2019-11-15 04:56:28.063: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 04:59:05.678: INFO @metrics_hook: train matching accuracy: 0.9929289641203703, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 04:59:06.972: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 04:59:07.291: INFO @evaluate_embedding: best threshold 1.0332740843296053 2019-11-15 04:59:07.381: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 04:59:07.381: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 04:59:07.568: INFO @decay_lr : LR updated to `0.0003525338` 2019-11-15 04:59:07.570: INFO @log_profile : T train: 46.459570 2019-11-15 04:59:07.570: INFO @log_profile : T valid: 1.365204 2019-11-15 04:59:07.570: INFO @log_profile : T read data: 66.478316 2019-11-15 04:59:07.570: INFO @log_profile : T hooks: 165.250476 2019-11-15 04:59:07.570: INFO @main_loop : Epoch 208 done 2019-11-15 04:59:07.570: INFO @main_loop : Training epoch 209 2019-11-15 05:01:10.536: INFO @log_variables: train loss nanmean: 0.042237 2019-11-15 05:01:10.537: INFO @log_variables: train positive_distance nanmean: 0.559350 2019-11-15 05:01:10.537: INFO @log_variables: train negative_distance nanmean: 1.419346 2019-11-15 05:01:10.537: INFO @log_variables: valid loss nanmean: 0.274497 2019-11-15 05:01:10.538: INFO @log_variables: valid positive_distance nanmean: 0.669622 2019-11-15 05:01:10.538: INFO @log_variables: valid negative_distance nanmean: 1.399553 2019-11-15 05:01:10.538: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:03:40.914: INFO @metrics_hook: train matching accuracy: 0.9931459160329502, N=110591, DB_SIZE=110592, N_IDS=7302 2019-11-15 05:03:42.692: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:03:43.145: INFO @evaluate_embedding: best threshold 1.0345874428749084 2019-11-15 05:03:43.305: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:03:43.306: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:03:43.550: INFO @decay_lr : LR updated to `0.00035077112` 2019-11-15 05:03:43.552: INFO @log_profile : T train: 47.327496 2019-11-15 05:03:43.552: INFO @log_profile : T valid: 1.570502 2019-11-15 05:03:43.552: INFO @log_profile : T read data: 67.765819 2019-11-15 05:03:43.552: INFO @log_profile : T hooks: 159.241778 2019-11-15 05:03:43.552: INFO @main_loop : Epoch 209 done 2019-11-15 05:03:43.552: INFO @main_loop : Training epoch 210 2019-11-15 05:05:53.903: INFO @log_variables: train loss nanmean: 0.043725 2019-11-15 05:05:53.904: INFO @log_variables: train positive_distance nanmean: 0.560472 2019-11-15 05:05:53.904: INFO @log_variables: train negative_distance nanmean: 1.419312 2019-11-15 05:05:53.904: INFO @log_variables: valid loss nanmean: 0.273226 2019-11-15 05:05:53.904: INFO @log_variables: valid positive_distance nanmean: 0.669811 2019-11-15 05:05:53.904: INFO @log_variables: valid negative_distance nanmean: 1.399310 2019-11-15 05:05:53.904: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:08:29.399: INFO @metrics_hook: train matching accuracy: 0.9923593026620371, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-15 05:08:30.780: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:08:31.142: INFO @evaluate_embedding: best threshold 1.0345604419708252 2019-11-15 05:08:31.379: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:08:31.380: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:08:31.764: INFO @decay_lr : LR updated to `0.00034901727` 2019-11-15 05:08:31.766: INFO @log_profile : T train: 46.855649 2019-11-15 05:08:31.766: INFO @log_profile : T valid: 1.404066 2019-11-15 05:08:31.767: INFO @log_profile : T read data: 75.716047 2019-11-15 05:08:31.767: INFO @log_profile : T hooks: 164.150406 2019-11-15 05:08:31.767: INFO @main_loop : Epoch 210 done 2019-11-15 05:08:31.767: INFO @main_loop : Training epoch 211 2019-11-15 05:10:39.196: INFO @log_variables: train loss nanmean: 0.042669 2019-11-15 05:10:39.197: INFO @log_variables: train positive_distance nanmean: 0.559406 2019-11-15 05:10:39.198: INFO @log_variables: train negative_distance nanmean: 1.419343 2019-11-15 05:10:39.198: INFO @log_variables: valid loss nanmean: 0.274078 2019-11-15 05:10:39.198: INFO @log_variables: valid positive_distance nanmean: 0.670229 2019-11-15 05:10:39.198: INFO @log_variables: valid negative_distance nanmean: 1.399799 2019-11-15 05:10:39.198: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:13:15.335: INFO @metrics_hook: train matching accuracy: 0.9925038430237816, N=110590, DB_SIZE=110592, N_IDS=7315 2019-11-15 05:13:16.857: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:13:17.241: INFO @evaluate_embedding: best threshold 1.0350143313407898 2019-11-15 05:13:17.410: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:13:17.410: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:13:17.790: INFO @decay_lr : LR updated to `0.00034727217` 2019-11-15 05:13:17.793: INFO @log_profile : T train: 47.882063 2019-11-15 05:13:17.793: INFO @log_profile : T valid: 1.583483 2019-11-15 05:13:17.793: INFO @log_profile : T read data: 71.634315 2019-11-15 05:13:17.794: INFO @log_profile : T hooks: 164.848941 2019-11-15 05:13:17.794: INFO @main_loop : Epoch 211 done 2019-11-15 05:13:17.794: INFO @main_loop : Training epoch 212 2019-11-15 05:15:27.055: INFO @log_variables: train loss nanmean: 0.041726 2019-11-15 05:15:27.056: INFO @log_variables: train positive_distance nanmean: 0.559516 2019-11-15 05:15:27.056: INFO @log_variables: train negative_distance nanmean: 1.419323 2019-11-15 05:15:27.056: INFO @log_variables: valid loss nanmean: 0.274269 2019-11-15 05:15:27.056: INFO @log_variables: valid positive_distance nanmean: 0.668864 2019-11-15 05:15:27.056: INFO @log_variables: valid negative_distance nanmean: 1.399320 2019-11-15 05:15:27.056: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:18:04.049: INFO @metrics_hook: train matching accuracy: 0.9933267625756165, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 05:18:05.771: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:18:06.128: INFO @evaluate_embedding: best threshold 1.034091830253601 2019-11-15 05:18:06.309: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:18:06.309: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:18:06.605: INFO @decay_lr : LR updated to `0.0003455358` 2019-11-15 05:18:06.607: INFO @log_profile : T train: 46.714003 2019-11-15 05:18:06.607: INFO @log_profile : T valid: 1.408651 2019-11-15 05:18:06.607: INFO @log_profile : T read data: 75.091923 2019-11-15 05:18:06.608: INFO @log_profile : T hooks: 165.515743 2019-11-15 05:18:06.608: INFO @main_loop : Epoch 212 done 2019-11-15 05:18:06.608: INFO @main_loop : Training epoch 213 2019-11-15 05:20:17.099: INFO @log_variables: train loss nanmean: 0.042346 2019-11-15 05:20:17.104: INFO @log_variables: train positive_distance nanmean: 0.559593 2019-11-15 05:20:17.104: INFO @log_variables: train negative_distance nanmean: 1.419327 2019-11-15 05:20:17.104: INFO @log_variables: valid loss nanmean: 0.275478 2019-11-15 05:20:17.104: INFO @log_variables: valid positive_distance nanmean: 0.669771 2019-11-15 05:20:17.104: INFO @log_variables: valid negative_distance nanmean: 1.399344 2019-11-15 05:20:17.104: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:22:50.726: INFO @metrics_hook: train matching accuracy: 0.9920970775462963, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-15 05:22:52.185: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:22:52.578: INFO @evaluate_embedding: best threshold 1.0345576703548431 2019-11-15 05:22:52.709: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:22:52.710: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:22:53.061: INFO @decay_lr : LR updated to `0.00034380812` 2019-11-15 05:22:53.062: INFO @log_profile : T train: 45.878488 2019-11-15 05:22:53.062: INFO @log_profile : T valid: 1.532822 2019-11-15 05:22:53.063: INFO @log_profile : T read data: 76.380979 2019-11-15 05:22:53.063: INFO @log_profile : T hooks: 162.583752 2019-11-15 05:22:53.063: INFO @main_loop : Epoch 213 done 2019-11-15 05:22:53.063: INFO @main_loop : Training epoch 214 2019-11-15 05:25:02.499: INFO @log_variables: train loss nanmean: 0.043474 2019-11-15 05:25:02.500: INFO @log_variables: train positive_distance nanmean: 0.559492 2019-11-15 05:25:02.500: INFO @log_variables: train negative_distance nanmean: 1.419318 2019-11-15 05:25:02.500: INFO @log_variables: valid loss nanmean: 0.275416 2019-11-15 05:25:02.500: INFO @log_variables: valid positive_distance nanmean: 0.671455 2019-11-15 05:25:02.500: INFO @log_variables: valid negative_distance nanmean: 1.399451 2019-11-15 05:25:02.501: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:27:35.143: INFO @metrics_hook: train matching accuracy: 0.9931187890515503, N=110591, DB_SIZE=110592, N_IDS=7322 2019-11-15 05:27:36.449: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:27:36.968: INFO @evaluate_embedding: best threshold 1.0354528725147247 2019-11-15 05:27:37.106: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:27:37.107: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:27:37.578: INFO @decay_lr : LR updated to `0.00034208907` 2019-11-15 05:27:37.582: INFO @log_profile : T train: 45.572621 2019-11-15 05:27:37.583: INFO @log_profile : T valid: 1.493440 2019-11-15 05:27:37.583: INFO @log_profile : T read data: 75.491392 2019-11-15 05:27:37.583: INFO @log_profile : T hooks: 161.879558 2019-11-15 05:27:37.583: INFO @main_loop : Epoch 214 done 2019-11-15 05:27:37.583: INFO @main_loop : Training epoch 215 2019-11-15 05:29:48.145: INFO @log_variables: train loss nanmean: 0.042242 2019-11-15 05:29:48.146: INFO @log_variables: train positive_distance nanmean: 0.559525 2019-11-15 05:29:48.146: INFO @log_variables: train negative_distance nanmean: 1.419343 2019-11-15 05:29:48.146: INFO @log_variables: valid loss nanmean: 0.272218 2019-11-15 05:29:48.147: INFO @log_variables: valid positive_distance nanmean: 0.670184 2019-11-15 05:29:48.147: INFO @log_variables: valid negative_distance nanmean: 1.400048 2019-11-15 05:29:48.147: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:32:23.462: INFO @metrics_hook: train matching accuracy: 0.9926847573491514, N=110591, DB_SIZE=110592, N_IDS=7320 2019-11-15 05:32:24.863: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:32:25.262: INFO @evaluate_embedding: best threshold 1.0351160764694212 2019-11-15 05:32:25.461: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:32:25.462: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:32:25.897: INFO @decay_lr : LR updated to `0.00034037864` 2019-11-15 05:32:25.899: INFO @log_profile : T train: 45.719870 2019-11-15 05:32:25.899: INFO @log_profile : T valid: 1.450307 2019-11-15 05:32:25.899: INFO @log_profile : T read data: 76.549370 2019-11-15 05:32:25.899: INFO @log_profile : T hooks: 164.516485 2019-11-15 05:32:25.899: INFO @main_loop : Epoch 215 done 2019-11-15 05:32:25.899: INFO @main_loop : Training epoch 216 2019-11-15 05:34:38.743: INFO @log_variables: train loss nanmean: 0.041958 2019-11-15 05:34:38.747: INFO @log_variables: train positive_distance nanmean: 0.557820 2019-11-15 05:34:38.747: INFO @log_variables: train negative_distance nanmean: 1.419344 2019-11-15 05:34:38.747: INFO @log_variables: valid loss nanmean: 0.271843 2019-11-15 05:34:38.747: INFO @log_variables: valid positive_distance nanmean: 0.669590 2019-11-15 05:34:38.747: INFO @log_variables: valid negative_distance nanmean: 1.398446 2019-11-15 05:34:38.747: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:37:09.934: INFO @metrics_hook: train matching accuracy: 0.9928294345832843, N=110591, DB_SIZE=110592, N_IDS=7304 2019-11-15 05:37:11.339: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:37:11.570: INFO @evaluate_embedding: best threshold 1.0340182781219482 2019-11-15 05:37:11.743: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:37:11.743: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:37:12.343: INFO @decay_lr : LR updated to `0.00033867673` 2019-11-15 05:37:12.346: INFO @log_profile : T train: 45.729260 2019-11-15 05:37:12.346: INFO @log_profile : T valid: 1.463165 2019-11-15 05:37:12.346: INFO @log_profile : T read data: 78.921727 2019-11-15 05:37:12.346: INFO @log_profile : T hooks: 160.249021 2019-11-15 05:37:12.346: INFO @main_loop : Epoch 216 done 2019-11-15 05:37:12.347: INFO @main_loop : Training epoch 217 2019-11-15 05:39:30.775: INFO @log_variables: train loss nanmean: 0.041860 2019-11-15 05:39:30.778: INFO @log_variables: train positive_distance nanmean: 0.559197 2019-11-15 05:39:30.778: INFO @log_variables: train negative_distance nanmean: 1.419343 2019-11-15 05:39:30.778: INFO @log_variables: valid loss nanmean: 0.275125 2019-11-15 05:39:30.778: INFO @log_variables: valid positive_distance nanmean: 0.670402 2019-11-15 05:39:30.778: INFO @log_variables: valid negative_distance nanmean: 1.399067 2019-11-15 05:39:30.779: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:41:58.894: INFO @metrics_hook: train matching accuracy: 0.992178387029686, N=110591, DB_SIZE=110592, N_IDS=7305 2019-11-15 05:41:59.977: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:42:00.363: INFO @evaluate_embedding: best threshold 1.0347346663475037 2019-11-15 05:42:00.631: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:42:00.631: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:42:00.993: INFO @decay_lr : LR updated to `0.00033698336` 2019-11-15 05:42:00.998: INFO @log_profile : T train: 46.648348 2019-11-15 05:42:00.998: INFO @log_profile : T valid: 1.540134 2019-11-15 05:42:00.998: INFO @log_profile : T read data: 83.796048 2019-11-15 05:42:00.998: INFO @log_profile : T hooks: 156.589755 2019-11-15 05:42:00.999: INFO @main_loop : Epoch 217 done 2019-11-15 05:42:00.999: INFO @main_loop : Training epoch 218 2019-11-15 05:44:19.331: INFO @log_variables: train loss nanmean: 0.043642 2019-11-15 05:44:19.335: INFO @log_variables: train positive_distance nanmean: 0.560011 2019-11-15 05:44:19.335: INFO @log_variables: train negative_distance nanmean: 1.419331 2019-11-15 05:44:19.335: INFO @log_variables: valid loss nanmean: 0.274264 2019-11-15 05:44:19.336: INFO @log_variables: valid positive_distance nanmean: 0.671159 2019-11-15 05:44:19.336: INFO @log_variables: valid negative_distance nanmean: 1.400058 2019-11-15 05:44:19.336: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:46:49.640: INFO @metrics_hook: train matching accuracy: 0.9926486545138888, N=110592, DB_SIZE=110592, N_IDS=7301 2019-11-15 05:46:51.001: INFO @metrics_hook: valid matching accuracy: 0.98816252532793, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:46:51.301: INFO @evaluate_embedding: best threshold 1.0356086790561678 2019-11-15 05:46:51.464: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:46:51.464: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:46:52.022: INFO @decay_lr : LR updated to `0.00033529845` 2019-11-15 05:46:52.644: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-15 05:46:52.652: INFO @log_profile : T train: 45.855825 2019-11-15 05:46:52.653: INFO @log_profile : T valid: 1.416348 2019-11-15 05:46:52.653: INFO @log_profile : T read data: 84.505549 2019-11-15 05:46:52.653: INFO @log_profile : T hooks: 159.802127 2019-11-15 05:46:52.653: INFO @main_loop : Epoch 218 done 2019-11-15 05:46:52.653: INFO @main_loop : Training epoch 219 2019-11-15 05:49:13.874: INFO @log_variables: train loss nanmean: 0.043297 2019-11-15 05:49:13.876: INFO @log_variables: train positive_distance nanmean: 0.559831 2019-11-15 05:49:13.876: INFO @log_variables: train negative_distance nanmean: 1.419347 2019-11-15 05:49:13.876: INFO @log_variables: valid loss nanmean: 0.272043 2019-11-15 05:49:13.876: INFO @log_variables: valid positive_distance nanmean: 0.670266 2019-11-15 05:49:13.876: INFO @log_variables: valid negative_distance nanmean: 1.400001 2019-11-15 05:49:13.876: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:51:40.796: INFO @metrics_hook: train matching accuracy: 0.9924948684793519, N=110591, DB_SIZE=110592, N_IDS=7318 2019-11-15 05:51:42.301: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:51:42.674: INFO @evaluate_embedding: best threshold 1.0351336002349854 2019-11-15 05:51:42.871: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:51:42.871: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:51:43.230: INFO @decay_lr : LR updated to `0.00033362195` 2019-11-15 05:51:43.232: INFO @log_profile : T train: 45.661213 2019-11-15 05:51:43.232: INFO @log_profile : T valid: 1.529573 2019-11-15 05:51:43.232: INFO @log_profile : T read data: 87.221428 2019-11-15 05:51:43.232: INFO @log_profile : T hooks: 156.070399 2019-11-15 05:51:43.232: INFO @main_loop : Epoch 219 done 2019-11-15 05:51:43.232: INFO @main_loop : Training epoch 220 2019-11-15 05:54:07.108: INFO @log_variables: train loss nanmean: 0.042589 2019-11-15 05:54:07.109: INFO @log_variables: train positive_distance nanmean: 0.559640 2019-11-15 05:54:07.109: INFO @log_variables: train negative_distance nanmean: 1.419326 2019-11-15 05:54:07.109: INFO @log_variables: valid loss nanmean: 0.271735 2019-11-15 05:54:07.109: INFO @log_variables: valid positive_distance nanmean: 0.670114 2019-11-15 05:54:07.109: INFO @log_variables: valid negative_distance nanmean: 1.400746 2019-11-15 05:54:07.109: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 05:56:39.224: INFO @metrics_hook: train matching accuracy: 0.9926938657407407, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-15 05:56:40.584: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 05:56:41.002: INFO @evaluate_embedding: best threshold 1.0354299545288084 2019-11-15 05:56:41.168: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 05:56:41.168: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 05:56:41.840: INFO @decay_lr : LR updated to `0.00033195384` 2019-11-15 05:56:41.843: INFO @log_profile : T train: 46.093747 2019-11-15 05:56:41.843: INFO @log_profile : T valid: 1.433897 2019-11-15 05:56:41.843: INFO @log_profile : T read data: 89.906555 2019-11-15 05:56:41.843: INFO @log_profile : T hooks: 161.079808 2019-11-15 05:56:41.844: INFO @main_loop : Epoch 220 done 2019-11-15 05:56:41.844: INFO @main_loop : Training epoch 221 2019-11-15 05:59:10.272: INFO @log_variables: train loss nanmean: 0.042420 2019-11-15 05:59:10.273: INFO @log_variables: train positive_distance nanmean: 0.559070 2019-11-15 05:59:10.273: INFO @log_variables: train negative_distance nanmean: 1.419324 2019-11-15 05:59:10.273: INFO @log_variables: valid loss nanmean: 0.275800 2019-11-15 05:59:10.273: INFO @log_variables: valid positive_distance nanmean: 0.668132 2019-11-15 05:59:10.273: INFO @log_variables: valid negative_distance nanmean: 1.400074 2019-11-15 05:59:10.273: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:01:38.648: INFO @metrics_hook: train matching accuracy: 0.9932453816314166, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-15 06:01:39.878: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:01:40.183: INFO @evaluate_embedding: best threshold 1.0341033041477206 2019-11-15 06:01:40.333: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:01:40.334: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:01:40.825: INFO @decay_lr : LR updated to `0.00033029407` 2019-11-15 06:01:40.827: INFO @log_profile : T train: 45.989539 2019-11-15 06:01:40.827: INFO @log_profile : T valid: 1.420089 2019-11-15 06:01:40.827: INFO @log_profile : T read data: 94.436721 2019-11-15 06:01:40.827: INFO @log_profile : T hooks: 157.063357 2019-11-15 06:01:40.828: INFO @main_loop : Epoch 221 done 2019-11-15 06:01:40.828: INFO @main_loop : Training epoch 222 2019-11-15 06:04:07.966: INFO @log_variables: train loss nanmean: 0.041899 2019-11-15 06:04:07.969: INFO @log_variables: train positive_distance nanmean: 0.560122 2019-11-15 06:04:07.969: INFO @log_variables: train negative_distance nanmean: 1.419336 2019-11-15 06:04:07.969: INFO @log_variables: valid loss nanmean: 0.272075 2019-11-15 06:04:07.969: INFO @log_variables: valid positive_distance nanmean: 0.667734 2019-11-15 06:04:07.969: INFO @log_variables: valid negative_distance nanmean: 1.399605 2019-11-15 06:04:07.969: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:06:39.414: INFO @metrics_hook: train matching accuracy: 0.9925219954607518, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-15 06:06:40.748: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:06:41.292: INFO @evaluate_embedding: best threshold 1.0336694717407227 2019-11-15 06:06:41.531: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:06:41.531: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:06:42.274: INFO @decay_lr : LR updated to `0.0003286426` 2019-11-15 06:06:42.279: INFO @log_profile : T train: 46.603568 2019-11-15 06:06:42.279: INFO @log_profile : T valid: 1.482248 2019-11-15 06:06:42.279: INFO @log_profile : T read data: 92.256064 2019-11-15 06:06:42.279: INFO @log_profile : T hooks: 161.019931 2019-11-15 06:06:42.279: INFO @main_loop : Epoch 222 done 2019-11-15 06:06:42.279: INFO @main_loop : Training epoch 223 2019-11-15 06:09:15.931: INFO @log_variables: train loss nanmean: 0.041436 2019-11-15 06:09:15.937: INFO @log_variables: train positive_distance nanmean: 0.558871 2019-11-15 06:09:15.937: INFO @log_variables: train negative_distance nanmean: 1.419338 2019-11-15 06:09:15.937: INFO @log_variables: valid loss nanmean: 0.270586 2019-11-15 06:09:15.937: INFO @log_variables: valid positive_distance nanmean: 0.667758 2019-11-15 06:09:15.937: INFO @log_variables: valid negative_distance nanmean: 1.399516 2019-11-15 06:09:15.937: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:11:40.293: INFO @metrics_hook: train matching accuracy: 0.9921150907397528, N=110591, DB_SIZE=110592, N_IDS=7317 2019-11-15 06:11:41.602: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:11:42.094: INFO @evaluate_embedding: best threshold 1.0336368083953857 2019-11-15 06:11:42.212: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:11:42.213: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:11:42.543: INFO @decay_lr : LR updated to `0.0003269994` 2019-11-15 06:11:42.545: INFO @log_profile : T train: 46.562408 2019-11-15 06:11:42.545: INFO @log_profile : T valid: 1.430184 2019-11-15 06:11:42.545: INFO @log_profile : T read data: 98.775471 2019-11-15 06:11:42.545: INFO @log_profile : T hooks: 153.381148 2019-11-15 06:11:42.545: INFO @main_loop : Epoch 223 done 2019-11-15 06:11:42.545: INFO @main_loop : Training epoch 224 2019-11-15 06:14:19.132: INFO @log_variables: train loss nanmean: 0.041955 2019-11-15 06:14:19.133: INFO @log_variables: train positive_distance nanmean: 0.558840 2019-11-15 06:14:19.133: INFO @log_variables: train negative_distance nanmean: 1.419343 2019-11-15 06:14:19.133: INFO @log_variables: valid loss nanmean: 0.273986 2019-11-15 06:14:19.133: INFO @log_variables: valid positive_distance nanmean: 0.671568 2019-11-15 06:14:19.134: INFO @log_variables: valid negative_distance nanmean: 1.399714 2019-11-15 06:14:19.134: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:16:46.858: INFO @metrics_hook: train matching accuracy: 0.9923231336805556, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-15 06:16:48.151: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:16:48.585: INFO @evaluate_embedding: best threshold 1.0356409549713133 2019-11-15 06:16:48.747: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:16:48.747: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:16:49.347: INFO @decay_lr : LR updated to `0.0003253644` 2019-11-15 06:16:49.349: INFO @log_profile : T train: 48.517442 2019-11-15 06:16:49.349: INFO @log_profile : T valid: 1.442787 2019-11-15 06:16:49.349: INFO @log_profile : T read data: 100.275630 2019-11-15 06:16:49.349: INFO @log_profile : T hooks: 156.495324 2019-11-15 06:16:49.349: INFO @main_loop : Epoch 224 done 2019-11-15 06:16:49.349: INFO @main_loop : Training epoch 225 2019-11-15 06:19:26.131: INFO @log_variables: train loss nanmean: 0.042595 2019-11-15 06:19:26.132: INFO @log_variables: train positive_distance nanmean: 0.558905 2019-11-15 06:19:26.133: INFO @log_variables: train negative_distance nanmean: 1.419334 2019-11-15 06:19:26.133: INFO @log_variables: valid loss nanmean: 0.267578 2019-11-15 06:19:26.133: INFO @log_variables: valid positive_distance nanmean: 0.670384 2019-11-15 06:19:26.133: INFO @log_variables: valid negative_distance nanmean: 1.400344 2019-11-15 06:19:26.133: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:21:52.143: INFO @metrics_hook: train matching accuracy: 0.9925853587962963, N=110592, DB_SIZE=110592, N_IDS=7302 2019-11-15 06:21:53.884: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:21:54.207: INFO @evaluate_embedding: best threshold 1.0353640615940094 2019-11-15 06:21:54.351: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:21:54.353: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:21:54.727: INFO @decay_lr : LR updated to `0.0003237376` 2019-11-15 06:21:54.730: INFO @log_profile : T train: 46.106363 2019-11-15 06:21:54.730: INFO @log_profile : T valid: 1.444574 2019-11-15 06:21:54.730: INFO @log_profile : T read data: 102.752631 2019-11-15 06:21:54.730: INFO @log_profile : T hooks: 154.991082 2019-11-15 06:21:54.731: INFO @main_loop : Epoch 225 done 2019-11-15 06:21:54.731: INFO @main_loop : Training epoch 226 2019-11-15 06:24:34.797: INFO @log_variables: train loss nanmean: 0.041280 2019-11-15 06:24:34.799: INFO @log_variables: train positive_distance nanmean: 0.557778 2019-11-15 06:24:34.799: INFO @log_variables: train negative_distance nanmean: 1.419338 2019-11-15 06:24:34.799: INFO @log_variables: valid loss nanmean: 0.270521 2019-11-15 06:24:34.799: INFO @log_variables: valid positive_distance nanmean: 0.670967 2019-11-15 06:24:34.799: INFO @log_variables: valid negative_distance nanmean: 1.399556 2019-11-15 06:24:34.799: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:27:04.107: INFO @metrics_hook: train matching accuracy: 0.9925582320601852, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-15 06:27:05.616: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:27:06.017: INFO @evaluate_embedding: best threshold 1.0352612435817716 2019-11-15 06:27:06.155: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:27:06.155: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:27:06.628: INFO @decay_lr : LR updated to `0.0003221189` 2019-11-15 06:27:06.630: INFO @log_profile : T train: 46.849951 2019-11-15 06:27:06.630: INFO @log_profile : T valid: 1.401129 2019-11-15 06:27:06.630: INFO @log_profile : T read data: 105.251376 2019-11-15 06:27:06.630: INFO @log_profile : T hooks: 158.322624 2019-11-15 06:27:06.630: INFO @main_loop : Epoch 226 done 2019-11-15 06:27:06.630: INFO @main_loop : Training epoch 227 2019-11-15 06:29:49.531: INFO @log_variables: train loss nanmean: 0.042047 2019-11-15 06:29:49.538: INFO @log_variables: train positive_distance nanmean: 0.559550 2019-11-15 06:29:49.538: INFO @log_variables: train negative_distance nanmean: 1.419337 2019-11-15 06:29:49.538: INFO @log_variables: valid loss nanmean: 0.271520 2019-11-15 06:29:49.538: INFO @log_variables: valid positive_distance nanmean: 0.666740 2019-11-15 06:29:49.538: INFO @log_variables: valid negative_distance nanmean: 1.400249 2019-11-15 06:29:49.538: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:32:18.879: INFO @metrics_hook: train matching accuracy: 0.9930465133101852, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 06:32:20.497: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:32:20.928: INFO @evaluate_embedding: best threshold 1.0334944427013395 2019-11-15 06:32:21.127: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:32:21.127: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:32:21.697: INFO @decay_lr : LR updated to `0.0003205083` 2019-11-15 06:32:21.700: INFO @log_profile : T train: 46.326415 2019-11-15 06:32:21.702: INFO @log_profile : T valid: 1.443879 2019-11-15 06:32:21.702: INFO @log_profile : T read data: 108.760903 2019-11-15 06:32:21.702: INFO @log_profile : T hooks: 158.439050 2019-11-15 06:32:21.702: INFO @main_loop : Epoch 227 done 2019-11-15 06:32:21.703: INFO @main_loop : Training epoch 228 2019-11-15 06:35:06.222: INFO @log_variables: train loss nanmean: 0.040999 2019-11-15 06:35:06.224: INFO @log_variables: train positive_distance nanmean: 0.557426 2019-11-15 06:35:06.224: INFO @log_variables: train negative_distance nanmean: 1.419346 2019-11-15 06:35:06.224: INFO @log_variables: valid loss nanmean: 0.268134 2019-11-15 06:35:06.224: INFO @log_variables: valid positive_distance nanmean: 0.668252 2019-11-15 06:35:06.224: INFO @log_variables: valid negative_distance nanmean: 1.400337 2019-11-15 06:35:06.224: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:37:31.790: INFO @metrics_hook: train matching accuracy: 0.9928747106481481, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 06:37:33.131: INFO @metrics_hook: valid matching accuracy: 0.9859230030926736, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:37:33.490: INFO @evaluate_embedding: best threshold 1.0342945456504822 2019-11-15 06:37:33.642: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:37:33.642: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:37:33.996: INFO @decay_lr : LR updated to `0.00031890575` 2019-11-15 06:37:33.998: INFO @log_profile : T train: 47.345862 2019-11-15 06:37:33.998: INFO @log_profile : T valid: 1.583762 2019-11-15 06:37:33.998: INFO @log_profile : T read data: 108.692919 2019-11-15 06:37:33.998: INFO @log_profile : T hooks: 154.583985 2019-11-15 06:37:33.999: INFO @main_loop : Epoch 228 done 2019-11-15 06:37:33.999: INFO @main_loop : Training epoch 229 2019-11-15 06:40:18.501: INFO @log_variables: train loss nanmean: 0.041725 2019-11-15 06:40:18.504: INFO @log_variables: train positive_distance nanmean: 0.559098 2019-11-15 06:40:18.504: INFO @log_variables: train negative_distance nanmean: 1.419335 2019-11-15 06:40:18.504: INFO @log_variables: valid loss nanmean: 0.271844 2019-11-15 06:40:18.505: INFO @log_variables: valid positive_distance nanmean: 0.669531 2019-11-15 06:40:18.505: INFO @log_variables: valid negative_distance nanmean: 1.399827 2019-11-15 06:40:18.505: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:42:42.565: INFO @metrics_hook: train matching accuracy: 0.9925491224421518, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 06:42:43.925: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:42:44.389: INFO @evaluate_embedding: best threshold 1.034678906202316 2019-11-15 06:42:44.614: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:42:44.615: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:42:45.173: INFO @decay_lr : LR updated to `0.0003173112` 2019-11-15 06:42:45.185: INFO @log_profile : T train: 46.202438 2019-11-15 06:42:45.186: INFO @log_profile : T valid: 1.442245 2019-11-15 06:42:45.186: INFO @log_profile : T read data: 110.357303 2019-11-15 06:42:45.186: INFO @log_profile : T hooks: 153.109003 2019-11-15 06:42:45.186: INFO @main_loop : Epoch 229 done 2019-11-15 06:42:45.186: INFO @main_loop : Training epoch 230 2019-11-15 06:45:33.290: INFO @log_variables: train loss nanmean: 0.042396 2019-11-15 06:45:33.292: INFO @log_variables: train positive_distance nanmean: 0.558829 2019-11-15 06:45:33.293: INFO @log_variables: train negative_distance nanmean: 1.419333 2019-11-15 06:45:33.293: INFO @log_variables: valid loss nanmean: 0.274188 2019-11-15 06:45:33.293: INFO @log_variables: valid positive_distance nanmean: 0.671374 2019-11-15 06:45:33.293: INFO @log_variables: valid negative_distance nanmean: 1.399902 2019-11-15 06:45:33.293: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:48:01.415: INFO @metrics_hook: train matching accuracy: 0.9922236689814815, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 06:48:02.661: INFO @metrics_hook: valid matching accuracy: 0.9879492374960008, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:48:05.844: INFO @evaluate_embedding: best threshold 1.0356381237506869 2019-11-15 06:48:06.094: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:48:06.098: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:48:06.549: INFO @decay_lr : LR updated to `0.00031572464` 2019-11-15 06:48:06.552: INFO @log_profile : T train: 46.719465 2019-11-15 06:48:06.552: INFO @log_profile : T valid: 1.433376 2019-11-15 06:48:06.552: INFO @log_profile : T read data: 113.588695 2019-11-15 06:48:06.553: INFO @log_profile : T hooks: 159.540732 2019-11-15 06:48:06.553: INFO @main_loop : Epoch 230 done 2019-11-15 06:48:06.553: INFO @main_loop : Training epoch 231 2019-11-15 06:50:57.441: INFO @log_variables: train loss nanmean: 0.042324 2019-11-15 06:50:57.445: INFO @log_variables: train positive_distance nanmean: 0.558437 2019-11-15 06:50:57.445: INFO @log_variables: train negative_distance nanmean: 1.419363 2019-11-15 06:50:57.445: INFO @log_variables: valid loss nanmean: 0.272444 2019-11-15 06:50:57.445: INFO @log_variables: valid positive_distance nanmean: 0.670367 2019-11-15 06:50:57.445: INFO @log_variables: valid negative_distance nanmean: 1.399711 2019-11-15 06:50:57.446: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:53:28.298: INFO @metrics_hook: train matching accuracy: 0.9919252018699533, N=110591, DB_SIZE=110592, N_IDS=7306 2019-11-15 06:53:29.555: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:53:29.884: INFO @evaluate_embedding: best threshold 1.0350389480590823 2019-11-15 06:53:30.049: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:53:30.049: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:53:30.559: INFO @decay_lr : LR updated to `0.00031414602` 2019-11-15 06:53:30.563: INFO @log_profile : T train: 46.757563 2019-11-15 06:53:30.563: INFO @log_profile : T valid: 1.561809 2019-11-15 06:53:30.563: INFO @log_profile : T read data: 115.937652 2019-11-15 06:53:30.563: INFO @log_profile : T hooks: 159.680403 2019-11-15 06:53:30.563: INFO @main_loop : Epoch 231 done 2019-11-15 06:53:30.563: INFO @main_loop : Training epoch 232 2019-11-15 06:56:22.328: INFO @log_variables: train loss nanmean: 0.040888 2019-11-15 06:56:22.329: INFO @log_variables: train positive_distance nanmean: 0.557880 2019-11-15 06:56:22.329: INFO @log_variables: train negative_distance nanmean: 1.419353 2019-11-15 06:56:22.329: INFO @log_variables: valid loss nanmean: 0.271899 2019-11-15 06:56:22.329: INFO @log_variables: valid positive_distance nanmean: 0.670435 2019-11-15 06:56:22.329: INFO @log_variables: valid negative_distance nanmean: 1.399939 2019-11-15 06:56:22.329: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 06:58:48.789: INFO @metrics_hook: train matching accuracy: 0.9929921964716839, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 06:58:50.520: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 06:58:50.943: INFO @evaluate_embedding: best threshold 1.03518682718277 2019-11-15 06:58:51.127: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 06:58:51.127: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 06:58:51.622: INFO @decay_lr : LR updated to `0.00031257528` 2019-11-15 06:58:51.626: INFO @log_profile : T train: 46.312920 2019-11-15 06:58:51.626: INFO @log_profile : T valid: 1.407319 2019-11-15 06:58:51.626: INFO @log_profile : T read data: 117.364237 2019-11-15 06:58:51.626: INFO @log_profile : T hooks: 155.904981 2019-11-15 06:58:51.626: INFO @main_loop : Epoch 232 done 2019-11-15 06:58:51.626: INFO @main_loop : Training epoch 233 2019-11-15 07:01:49.362: INFO @log_variables: train loss nanmean: 0.041143 2019-11-15 07:01:49.363: INFO @log_variables: train positive_distance nanmean: 0.558028 2019-11-15 07:01:49.363: INFO @log_variables: train negative_distance nanmean: 1.419344 2019-11-15 07:01:49.363: INFO @log_variables: valid loss nanmean: 0.271862 2019-11-15 07:01:49.363: INFO @log_variables: valid positive_distance nanmean: 0.671412 2019-11-15 07:01:49.363: INFO @log_variables: valid negative_distance nanmean: 1.400086 2019-11-15 07:01:49.363: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:04:11.831: INFO @metrics_hook: train matching accuracy: 0.9923321759259259, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 07:04:13.289: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:04:13.568: INFO @evaluate_embedding: best threshold 1.0357489287853239 2019-11-15 07:04:13.773: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:04:13.773: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:04:14.152: INFO @decay_lr : LR updated to `0.0003110124` 2019-11-15 07:04:14.154: INFO @log_profile : T train: 47.356242 2019-11-15 07:04:14.154: INFO @log_profile : T valid: 1.461940 2019-11-15 07:04:14.154: INFO @log_profile : T read data: 122.430229 2019-11-15 07:04:14.155: INFO @log_profile : T hooks: 151.192673 2019-11-15 07:04:14.155: INFO @main_loop : Epoch 233 done 2019-11-15 07:04:14.155: INFO @main_loop : Training epoch 234 2019-11-15 07:07:13.301: INFO @log_variables: train loss nanmean: 0.042375 2019-11-15 07:07:13.302: INFO @log_variables: train positive_distance nanmean: 0.558904 2019-11-15 07:07:13.302: INFO @log_variables: train negative_distance nanmean: 1.419356 2019-11-15 07:07:13.302: INFO @log_variables: valid loss nanmean: 0.274620 2019-11-15 07:07:13.303: INFO @log_variables: valid positive_distance nanmean: 0.672387 2019-11-15 07:07:13.303: INFO @log_variables: valid negative_distance nanmean: 1.399896 2019-11-15 07:07:13.303: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:09:40.967: INFO @metrics_hook: train matching accuracy: 0.9925130208333334, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 07:09:42.154: INFO @metrics_hook: valid matching accuracy: 0.9861362909246028, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:09:42.543: INFO @evaluate_embedding: best threshold 1.0361411869525912 2019-11-15 07:09:42.737: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:09:42.737: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:09:43.386: INFO @decay_lr : LR updated to `0.00030945733` 2019-11-15 07:09:43.411: INFO @log_profile : T train: 46.842698 2019-11-15 07:09:43.412: INFO @log_profile : T valid: 1.432835 2019-11-15 07:09:43.412: INFO @log_profile : T read data: 124.090065 2019-11-15 07:09:43.412: INFO @log_profile : T hooks: 156.817953 2019-11-15 07:09:43.412: INFO @main_loop : Epoch 234 done 2019-11-15 07:09:43.415: INFO @main_loop : Training epoch 235 2019-11-15 07:12:42.079: INFO @log_variables: train loss nanmean: 0.041922 2019-11-15 07:12:42.081: INFO @log_variables: train positive_distance nanmean: 0.559360 2019-11-15 07:12:42.081: INFO @log_variables: train negative_distance nanmean: 1.419355 2019-11-15 07:12:42.081: INFO @log_variables: valid loss nanmean: 0.270089 2019-11-15 07:12:42.081: INFO @log_variables: valid positive_distance nanmean: 0.670410 2019-11-15 07:12:42.081: INFO @log_variables: valid negative_distance nanmean: 1.399779 2019-11-15 07:12:42.082: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:15:06.125: INFO @metrics_hook: train matching accuracy: 0.9918347047653495, N=110590, DB_SIZE=110592, N_IDS=7305 2019-11-15 07:15:07.442: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:15:07.692: INFO @evaluate_embedding: best threshold 1.0350947082042694 2019-11-15 07:15:07.789: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:15:07.790: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:15:08.014: INFO @decay_lr : LR updated to `0.00030791006` 2019-11-15 07:15:08.016: INFO @log_profile : T train: 47.136516 2019-11-15 07:15:08.017: INFO @log_profile : T valid: 1.403874 2019-11-15 07:15:08.017: INFO @log_profile : T read data: 123.971027 2019-11-15 07:15:08.017: INFO @log_profile : T hooks: 152.016411 2019-11-15 07:15:08.017: INFO @main_loop : Epoch 235 done 2019-11-15 07:15:08.018: INFO @main_loop : Training epoch 236 2019-11-15 07:18:14.780: INFO @log_variables: train loss nanmean: 0.041138 2019-11-15 07:18:14.782: INFO @log_variables: train positive_distance nanmean: 0.558003 2019-11-15 07:18:14.782: INFO @log_variables: train negative_distance nanmean: 1.419363 2019-11-15 07:18:14.783: INFO @log_variables: valid loss nanmean: 0.272387 2019-11-15 07:18:14.783: INFO @log_variables: valid positive_distance nanmean: 0.669675 2019-11-15 07:18:14.783: INFO @log_variables: valid negative_distance nanmean: 1.399987 2019-11-15 07:18:14.783: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:20:44.133: INFO @metrics_hook: train matching accuracy: 0.9926574975811338, N=110589, DB_SIZE=110592, N_IDS=7307 2019-11-15 07:20:45.362: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:20:45.647: INFO @evaluate_embedding: best threshold 1.0348305106163025 2019-11-15 07:20:45.751: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:20:45.751: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:20:46.173: INFO @decay_lr : LR updated to `0.0003063705` 2019-11-15 07:20:46.175: INFO @log_profile : T train: 46.996552 2019-11-15 07:20:46.176: INFO @log_profile : T valid: 1.429120 2019-11-15 07:20:46.176: INFO @log_profile : T read data: 131.628916 2019-11-15 07:20:46.176: INFO @log_profile : T hooks: 158.015100 2019-11-15 07:20:46.176: INFO @main_loop : Epoch 236 done 2019-11-15 07:20:46.176: INFO @main_loop : Training epoch 237 2019-11-15 07:23:43.462: INFO @log_variables: train loss nanmean: 0.041970 2019-11-15 07:23:43.463: INFO @log_variables: train positive_distance nanmean: 0.559009 2019-11-15 07:23:43.463: INFO @log_variables: train negative_distance nanmean: 1.419341 2019-11-15 07:23:43.463: INFO @log_variables: valid loss nanmean: 0.276162 2019-11-15 07:23:43.464: INFO @log_variables: valid positive_distance nanmean: 0.671344 2019-11-15 07:23:43.464: INFO @log_variables: valid negative_distance nanmean: 1.399428 2019-11-15 07:23:43.464: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:26:11.540: INFO @metrics_hook: train matching accuracy: 0.9922326409924859, N=110591, DB_SIZE=110592, N_IDS=7303 2019-11-15 07:26:13.008: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:26:13.276: INFO @evaluate_embedding: best threshold 1.03538578748703 2019-11-15 07:26:13.367: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:26:13.367: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:26:13.772: INFO @decay_lr : LR updated to `0.00030483864` 2019-11-15 07:26:13.776: INFO @log_profile : T train: 46.495632 2019-11-15 07:26:13.776: INFO @log_profile : T valid: 1.396496 2019-11-15 07:26:13.776: INFO @log_profile : T read data: 123.013706 2019-11-15 07:26:13.776: INFO @log_profile : T hooks: 156.620501 2019-11-15 07:26:13.776: INFO @main_loop : Epoch 237 done 2019-11-15 07:26:13.776: INFO @main_loop : Training epoch 238 2019-11-15 07:29:14.838: INFO @log_variables: train loss nanmean: 0.040699 2019-11-15 07:29:14.839: INFO @log_variables: train positive_distance nanmean: 0.558694 2019-11-15 07:29:14.839: INFO @log_variables: train negative_distance nanmean: 1.419361 2019-11-15 07:29:14.840: INFO @log_variables: valid loss nanmean: 0.270652 2019-11-15 07:29:14.840: INFO @log_variables: valid positive_distance nanmean: 0.670462 2019-11-15 07:29:14.840: INFO @log_variables: valid negative_distance nanmean: 1.399398 2019-11-15 07:29:14.840: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:31:40.137: INFO @metrics_hook: train matching accuracy: 0.9921694155092593, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-15 07:31:41.553: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:31:41.801: INFO @evaluate_embedding: best threshold 1.034929931163788 2019-11-15 07:31:41.906: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:31:41.906: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:31:42.177: INFO @decay_lr : LR updated to `0.00030331445` 2019-11-15 07:31:42.179: INFO @log_profile : T train: 46.934498 2019-11-15 07:31:42.179: INFO @log_profile : T valid: 1.442633 2019-11-15 07:31:42.180: INFO @log_profile : T read data: 125.885162 2019-11-15 07:31:42.180: INFO @log_profile : T hooks: 154.069949 2019-11-15 07:31:42.180: INFO @main_loop : Epoch 238 done 2019-11-15 07:31:42.180: INFO @main_loop : Training epoch 239 2019-11-15 07:34:39.594: INFO @log_variables: train loss nanmean: 0.041447 2019-11-15 07:34:39.595: INFO @log_variables: train positive_distance nanmean: 0.558298 2019-11-15 07:34:39.595: INFO @log_variables: train negative_distance nanmean: 1.419358 2019-11-15 07:34:39.596: INFO @log_variables: valid loss nanmean: 0.274438 2019-11-15 07:34:39.596: INFO @log_variables: valid positive_distance nanmean: 0.671131 2019-11-15 07:34:39.596: INFO @log_variables: valid negative_distance nanmean: 1.399459 2019-11-15 07:34:39.596: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:37:13.250: INFO @metrics_hook: train matching accuracy: 0.9929108796296297, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-15 07:37:14.768: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:37:15.088: INFO @evaluate_embedding: best threshold 1.0352947115898135 2019-11-15 07:37:15.183: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:37:15.183: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:37:15.642: INFO @decay_lr : LR updated to `0.00030179787` 2019-11-15 07:37:15.645: INFO @log_profile : T train: 46.456565 2019-11-15 07:37:15.645: INFO @log_profile : T valid: 1.415216 2019-11-15 07:37:15.645: INFO @log_profile : T read data: 123.143384 2019-11-15 07:37:15.645: INFO @log_profile : T hooks: 162.378538 2019-11-15 07:37:15.645: INFO @main_loop : Epoch 239 done 2019-11-15 07:37:15.646: INFO @main_loop : Training epoch 240 2019-11-15 07:40:16.187: INFO @log_variables: train loss nanmean: 0.040764 2019-11-15 07:40:16.188: INFO @log_variables: train positive_distance nanmean: 0.559124 2019-11-15 07:40:16.188: INFO @log_variables: train negative_distance nanmean: 1.419347 2019-11-15 07:40:16.188: INFO @log_variables: valid loss nanmean: 0.273121 2019-11-15 07:40:16.188: INFO @log_variables: valid positive_distance nanmean: 0.670774 2019-11-15 07:40:16.188: INFO @log_variables: valid negative_distance nanmean: 1.399232 2019-11-15 07:40:16.188: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:42:44.091: INFO @metrics_hook: train matching accuracy: 0.9929198578546174, N=110591, DB_SIZE=110592, N_IDS=7317 2019-11-15 07:42:45.438: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:42:45.706: INFO @evaluate_embedding: best threshold 1.035003066062927 2019-11-15 07:42:45.822: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:42:45.822: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:42:46.142: INFO @decay_lr : LR updated to `0.0003002889` 2019-11-15 07:42:46.145: INFO @log_profile : T train: 46.457720 2019-11-15 07:42:46.147: INFO @log_profile : T valid: 1.386338 2019-11-15 07:42:46.147: INFO @log_profile : T read data: 126.850879 2019-11-15 07:42:46.147: INFO @log_profile : T hooks: 155.720926 2019-11-15 07:42:46.147: INFO @main_loop : Epoch 240 done 2019-11-15 07:42:46.147: INFO @main_loop : Training epoch 241 2019-11-15 07:45:49.725: INFO @log_variables: train loss nanmean: 0.040845 2019-11-15 07:45:49.726: INFO @log_variables: train positive_distance nanmean: 0.558455 2019-11-15 07:45:49.726: INFO @log_variables: train negative_distance nanmean: 1.419347 2019-11-15 07:45:49.726: INFO @log_variables: valid loss nanmean: 0.267990 2019-11-15 07:45:49.726: INFO @log_variables: valid positive_distance nanmean: 0.670169 2019-11-15 07:45:49.726: INFO @log_variables: valid negative_distance nanmean: 1.398970 2019-11-15 07:45:49.726: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:48:18.676: INFO @metrics_hook: train matching accuracy: 0.9924858940972222, N=110592, DB_SIZE=110592, N_IDS=7303 2019-11-15 07:48:20.031: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:48:20.296: INFO @evaluate_embedding: best threshold 1.0345698595046997 2019-11-15 07:48:20.399: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:48:20.399: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:48:20.822: INFO @decay_lr : LR updated to `0.00029878746` 2019-11-15 07:48:20.826: INFO @log_profile : T train: 48.036903 2019-11-15 07:48:20.826: INFO @log_profile : T valid: 1.488418 2019-11-15 07:48:20.826: INFO @log_profile : T read data: 125.729722 2019-11-15 07:48:20.826: INFO @log_profile : T hooks: 159.338421 2019-11-15 07:48:20.826: INFO @main_loop : Epoch 241 done 2019-11-15 07:48:20.826: INFO @main_loop : Training epoch 242 2019-11-15 07:51:18.314: INFO @log_variables: train loss nanmean: 0.040715 2019-11-15 07:51:18.319: INFO @log_variables: train positive_distance nanmean: 0.558631 2019-11-15 07:51:18.319: INFO @log_variables: train negative_distance nanmean: 1.419358 2019-11-15 07:51:18.319: INFO @log_variables: valid loss nanmean: 0.270846 2019-11-15 07:51:18.319: INFO @log_variables: valid positive_distance nanmean: 0.671845 2019-11-15 07:51:18.319: INFO @log_variables: valid negative_distance nanmean: 1.399736 2019-11-15 07:51:18.319: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:53:49.937: INFO @metrics_hook: train matching accuracy: 0.9928747106481481, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 07:53:51.300: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:53:51.587: INFO @evaluate_embedding: best threshold 1.0357907116413116 2019-11-15 07:53:51.702: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:53:51.702: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:53:52.174: INFO @decay_lr : LR updated to `0.00029729353` 2019-11-15 07:53:52.178: INFO @log_profile : T train: 48.312618 2019-11-15 07:53:52.179: INFO @log_profile : T valid: 1.749536 2019-11-15 07:53:52.179: INFO @log_profile : T read data: 118.549307 2019-11-15 07:53:52.179: INFO @log_profile : T hooks: 162.670411 2019-11-15 07:53:52.179: INFO @main_loop : Epoch 242 done 2019-11-15 07:53:52.179: INFO @main_loop : Training epoch 243 2019-11-15 07:56:57.136: INFO @log_variables: train loss nanmean: 0.040757 2019-11-15 07:56:57.136: INFO @log_variables: train positive_distance nanmean: 0.558962 2019-11-15 07:56:57.136: INFO @log_variables: train negative_distance nanmean: 1.419344 2019-11-15 07:56:57.136: INFO @log_variables: valid loss nanmean: 0.272181 2019-11-15 07:56:57.136: INFO @log_variables: valid positive_distance nanmean: 0.672129 2019-11-15 07:56:57.137: INFO @log_variables: valid negative_distance nanmean: 1.399768 2019-11-15 07:56:57.137: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 07:59:21.589: INFO @metrics_hook: train matching accuracy: 0.9926667390046297, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-15 07:59:23.007: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 07:59:23.243: INFO @evaluate_embedding: best threshold 1.0359484851360319 2019-11-15 07:59:23.352: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 07:59:23.352: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 07:59:23.607: INFO @decay_lr : LR updated to `0.00029580705` 2019-11-15 07:59:23.609: INFO @log_profile : T train: 49.383411 2019-11-15 07:59:23.609: INFO @log_profile : T valid: 1.703942 2019-11-15 07:59:23.609: INFO @log_profile : T read data: 124.602141 2019-11-15 07:59:23.609: INFO @log_profile : T hooks: 155.634648 2019-11-15 07:59:23.609: INFO @main_loop : Epoch 243 done 2019-11-15 07:59:23.609: INFO @main_loop : Training epoch 244 2019-11-15 08:02:17.382: INFO @log_variables: train loss nanmean: 0.040135 2019-11-15 08:02:17.384: INFO @log_variables: train positive_distance nanmean: 0.557635 2019-11-15 08:02:17.384: INFO @log_variables: train negative_distance nanmean: 1.419364 2019-11-15 08:02:17.384: INFO @log_variables: valid loss nanmean: 0.270726 2019-11-15 08:02:17.384: INFO @log_variables: valid positive_distance nanmean: 0.670823 2019-11-15 08:02:17.384: INFO @log_variables: valid negative_distance nanmean: 1.399322 2019-11-15 08:02:17.384: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:04:44.572: INFO @metrics_hook: train matching accuracy: 0.9923954716435185, N=110592, DB_SIZE=110592, N_IDS=7299 2019-11-15 08:04:46.080: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:04:46.365: INFO @evaluate_embedding: best threshold 1.0350728034973145 2019-11-15 08:04:46.474: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:04:46.474: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:04:46.887: INFO @decay_lr : LR updated to `0.00029432803` 2019-11-15 08:04:46.891: INFO @log_profile : T train: 47.226113 2019-11-15 08:04:46.891: INFO @log_profile : T valid: 1.527070 2019-11-15 08:04:46.891: INFO @log_profile : T read data: 116.304988 2019-11-15 08:04:46.891: INFO @log_profile : T hooks: 158.086129 2019-11-15 08:04:46.891: INFO @main_loop : Epoch 244 done 2019-11-15 08:04:46.891: INFO @main_loop : Training epoch 245 2019-11-15 08:07:43.538: INFO @log_variables: train loss nanmean: 0.040895 2019-11-15 08:07:43.539: INFO @log_variables: train positive_distance nanmean: 0.558081 2019-11-15 08:07:43.540: INFO @log_variables: train negative_distance nanmean: 1.419355 2019-11-15 08:07:43.540: INFO @log_variables: valid loss nanmean: 0.271694 2019-11-15 08:07:43.540: INFO @log_variables: valid positive_distance nanmean: 0.671268 2019-11-15 08:07:43.540: INFO @log_variables: valid negative_distance nanmean: 1.399284 2019-11-15 08:07:43.540: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:10:10.700: INFO @metrics_hook: train matching accuracy: 0.9928022425174067, N=110590, DB_SIZE=110592, N_IDS=7311 2019-11-15 08:10:12.214: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:10:12.521: INFO @evaluate_embedding: best threshold 1.035275846719742 2019-11-15 08:10:12.640: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:10:12.640: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:10:13.047: INFO @decay_lr : LR updated to `0.0002928564` 2019-11-15 08:10:13.050: INFO @log_profile : T train: 48.547636 2019-11-15 08:10:13.051: INFO @log_profile : T valid: 1.713301 2019-11-15 08:10:13.051: INFO @log_profile : T read data: 117.752277 2019-11-15 08:10:13.051: INFO @log_profile : T hooks: 158.060925 2019-11-15 08:10:13.051: INFO @main_loop : Epoch 245 done 2019-11-15 08:10:13.051: INFO @main_loop : Training epoch 246 2019-11-15 08:13:08.110: INFO @log_variables: train loss nanmean: 0.040787 2019-11-15 08:13:08.111: INFO @log_variables: train positive_distance nanmean: 0.558179 2019-11-15 08:13:08.111: INFO @log_variables: train negative_distance nanmean: 1.419358 2019-11-15 08:13:08.111: INFO @log_variables: valid loss nanmean: 0.272167 2019-11-15 08:13:08.112: INFO @log_variables: valid positive_distance nanmean: 0.669601 2019-11-15 08:13:08.112: INFO @log_variables: valid negative_distance nanmean: 1.399410 2019-11-15 08:13:08.112: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:15:34.527: INFO @metrics_hook: train matching accuracy: 0.9923593026620371, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-15 08:15:36.029: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:15:36.283: INFO @evaluate_embedding: best threshold 1.0345055460929873 2019-11-15 08:15:36.402: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:15:36.402: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:15:36.854: INFO @decay_lr : LR updated to `0.00029139212` 2019-11-15 08:15:36.856: INFO @log_profile : T train: 47.088361 2019-11-15 08:15:36.856: INFO @log_profile : T valid: 1.515903 2019-11-15 08:15:36.856: INFO @log_profile : T read data: 117.544317 2019-11-15 08:15:36.857: INFO @log_profile : T hooks: 157.565681 2019-11-15 08:15:36.857: INFO @main_loop : Epoch 246 done 2019-11-15 08:15:36.857: INFO @main_loop : Training epoch 247 2019-11-15 08:18:26.249: INFO @log_variables: train loss nanmean: 0.040462 2019-11-15 08:18:26.249: INFO @log_variables: train positive_distance nanmean: 0.557756 2019-11-15 08:18:26.250: INFO @log_variables: train negative_distance nanmean: 1.419352 2019-11-15 08:18:26.250: INFO @log_variables: valid loss nanmean: 0.272923 2019-11-15 08:18:26.250: INFO @log_variables: valid positive_distance nanmean: 0.669669 2019-11-15 08:18:26.250: INFO @log_variables: valid negative_distance nanmean: 1.399681 2019-11-15 08:18:26.250: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:20:58.703: INFO @metrics_hook: train matching accuracy: 0.9923681378798976, N=110589, DB_SIZE=110592, N_IDS=7305 2019-11-15 08:21:00.115: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:21:00.414: INFO @evaluate_embedding: best threshold 1.0346753895282743 2019-11-15 08:21:00.523: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:21:00.523: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:21:00.970: INFO @decay_lr : LR updated to `0.00028993515` 2019-11-15 08:21:00.973: INFO @log_profile : T train: 46.043557 2019-11-15 08:21:00.973: INFO @log_profile : T valid: 1.523770 2019-11-15 08:21:00.973: INFO @log_profile : T read data: 112.568547 2019-11-15 08:21:00.973: INFO @log_profile : T hooks: 163.893727 2019-11-15 08:21:00.973: INFO @main_loop : Epoch 247 done 2019-11-15 08:21:00.973: INFO @main_loop : Training epoch 248 2019-11-15 08:23:50.332: INFO @log_variables: train loss nanmean: 0.039302 2019-11-15 08:23:50.332: INFO @log_variables: train positive_distance nanmean: 0.558171 2019-11-15 08:23:50.332: INFO @log_variables: train negative_distance nanmean: 1.419360 2019-11-15 08:23:50.333: INFO @log_variables: valid loss nanmean: 0.271462 2019-11-15 08:23:50.333: INFO @log_variables: valid positive_distance nanmean: 0.670859 2019-11-15 08:23:50.333: INFO @log_variables: valid negative_distance nanmean: 1.399161 2019-11-15 08:23:50.333: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:26:15.764: INFO @metrics_hook: train matching accuracy: 0.9928113499290178, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-15 08:26:16.869: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:26:17.094: INFO @evaluate_embedding: best threshold 1.0350097715854645 2019-11-15 08:26:17.194: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:26:17.194: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:26:17.413: INFO @decay_lr : LR updated to `0.0002884855` 2019-11-15 08:26:17.414: INFO @log_profile : T train: 46.093226 2019-11-15 08:26:17.414: INFO @log_profile : T valid: 1.501328 2019-11-15 08:26:17.414: INFO @log_profile : T read data: 112.196669 2019-11-15 08:26:17.414: INFO @log_profile : T hooks: 156.561953 2019-11-15 08:26:17.414: INFO @main_loop : Epoch 248 done 2019-11-15 08:26:17.414: INFO @main_loop : Training epoch 249 2019-11-15 08:28:36.690: INFO @log_variables: train loss nanmean: 0.040199 2019-11-15 08:28:36.693: INFO @log_variables: train positive_distance nanmean: 0.558208 2019-11-15 08:28:36.694: INFO @log_variables: train negative_distance nanmean: 1.419369 2019-11-15 08:28:36.694: INFO @log_variables: valid loss nanmean: 0.275292 2019-11-15 08:28:36.694: INFO @log_variables: valid positive_distance nanmean: 0.672047 2019-11-15 08:28:36.695: INFO @log_variables: valid negative_distance nanmean: 1.399349 2019-11-15 08:28:36.695: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:30:46.383: INFO @metrics_hook: train matching accuracy: 0.9925672743055556, N=110592, DB_SIZE=110592, N_IDS=7298 2019-11-15 08:30:47.578: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:30:47.808: INFO @evaluate_embedding: best threshold 1.0356982350349426 2019-11-15 08:30:47.895: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:30:47.895: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:30:48.195: INFO @decay_lr : LR updated to `0.00028704308` 2019-11-15 08:30:48.198: INFO @log_profile : T train: 45.140238 2019-11-15 08:30:48.198: INFO @log_profile : T valid: 1.477768 2019-11-15 08:30:48.198: INFO @log_profile : T read data: 84.696740 2019-11-15 08:30:48.198: INFO @log_profile : T hooks: 139.396093 2019-11-15 08:30:48.198: INFO @main_loop : Epoch 249 done 2019-11-15 08:30:48.198: INFO @main_loop : Training epoch 250 2019-11-15 08:33:02.690: INFO @log_variables: train loss nanmean: 0.039616 2019-11-15 08:33:02.691: INFO @log_variables: train positive_distance nanmean: 0.556995 2019-11-15 08:33:02.691: INFO @log_variables: train negative_distance nanmean: 1.419370 2019-11-15 08:33:02.691: INFO @log_variables: valid loss nanmean: 0.273068 2019-11-15 08:33:02.691: INFO @log_variables: valid positive_distance nanmean: 0.672760 2019-11-15 08:33:02.691: INFO @log_variables: valid negative_distance nanmean: 1.399024 2019-11-15 08:33:02.691: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:35:12.062: INFO @metrics_hook: train matching accuracy: 0.9931098090277778, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 08:35:13.146: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:35:13.372: INFO @evaluate_embedding: best threshold 1.0358917117118835 2019-11-15 08:35:13.482: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:35:13.482: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:35:13.774: INFO @decay_lr : LR updated to `0.00028560785` 2019-11-15 08:35:13.777: INFO @log_profile : T train: 44.602754 2019-11-15 08:35:13.777: INFO @log_profile : T valid: 1.525035 2019-11-15 08:35:13.777: INFO @log_profile : T read data: 80.411638 2019-11-15 08:35:13.777: INFO @log_profile : T hooks: 138.958488 2019-11-15 08:35:13.777: INFO @main_loop : Epoch 250 done 2019-11-15 08:35:13.777: INFO @main_loop : Training epoch 251 2019-11-15 08:37:25.772: INFO @log_variables: train loss nanmean: 0.040836 2019-11-15 08:37:25.777: INFO @log_variables: train positive_distance nanmean: 0.557357 2019-11-15 08:37:25.777: INFO @log_variables: train negative_distance nanmean: 1.419375 2019-11-15 08:37:25.777: INFO @log_variables: valid loss nanmean: 0.272235 2019-11-15 08:37:25.777: INFO @log_variables: valid positive_distance nanmean: 0.673755 2019-11-15 08:37:25.777: INFO @log_variables: valid negative_distance nanmean: 1.399755 2019-11-15 08:37:25.778: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:39:37.174: INFO @metrics_hook: train matching accuracy: 0.9917896412037037, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 08:39:38.370: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:39:38.555: INFO @evaluate_embedding: best threshold 1.036755383014679 2019-11-15 08:39:38.648: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:39:38.648: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:39:38.982: INFO @decay_lr : LR updated to `0.0002841798` 2019-11-15 08:39:38.985: INFO @log_profile : T train: 44.504804 2019-11-15 08:39:38.985: INFO @log_profile : T valid: 1.469933 2019-11-15 08:39:38.985: INFO @log_profile : T read data: 77.913125 2019-11-15 08:39:38.985: INFO @log_profile : T hooks: 141.245862 2019-11-15 08:39:38.985: INFO @main_loop : Epoch 251 done 2019-11-15 08:39:38.986: INFO @main_loop : Training epoch 252 2019-11-15 08:41:45.270: INFO @log_variables: train loss nanmean: 0.040099 2019-11-15 08:41:45.272: INFO @log_variables: train positive_distance nanmean: 0.558670 2019-11-15 08:41:45.272: INFO @log_variables: train negative_distance nanmean: 1.419356 2019-11-15 08:41:45.272: INFO @log_variables: valid loss nanmean: 0.273975 2019-11-15 08:41:45.272: INFO @log_variables: valid positive_distance nanmean: 0.673454 2019-11-15 08:41:45.273: INFO @log_variables: valid negative_distance nanmean: 1.399501 2019-11-15 08:41:45.273: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:43:54.293: INFO @metrics_hook: train matching accuracy: 0.9924586991708186, N=110591, DB_SIZE=110592, N_IDS=7305 2019-11-15 08:43:55.233: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:43:55.396: INFO @evaluate_embedding: best threshold 1.0364776849746706 2019-11-15 08:43:55.465: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:43:55.465: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:43:55.640: INFO @decay_lr : LR updated to `0.0002827589` 2019-11-15 08:43:55.642: INFO @log_profile : T train: 44.461937 2019-11-15 08:43:55.642: INFO @log_profile : T valid: 1.452256 2019-11-15 08:43:55.642: INFO @log_profile : T read data: 71.695600 2019-11-15 08:43:55.642: INFO @log_profile : T hooks: 138.950664 2019-11-15 08:43:55.642: INFO @main_loop : Epoch 252 done 2019-11-15 08:43:55.642: INFO @main_loop : Training epoch 253 2019-11-15 08:45:55.939: INFO @log_variables: train loss nanmean: 0.040143 2019-11-15 08:45:55.940: INFO @log_variables: train positive_distance nanmean: 0.558931 2019-11-15 08:45:55.940: INFO @log_variables: train negative_distance nanmean: 1.419371 2019-11-15 08:45:55.941: INFO @log_variables: valid loss nanmean: 0.274877 2019-11-15 08:45:55.941: INFO @log_variables: valid positive_distance nanmean: 0.672928 2019-11-15 08:45:55.941: INFO @log_variables: valid negative_distance nanmean: 1.399074 2019-11-15 08:45:55.941: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:48:09.853: INFO @metrics_hook: train matching accuracy: 0.9930826822916666, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 08:48:10.984: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:48:11.178: INFO @evaluate_embedding: best threshold 1.0360006988048553 2019-11-15 08:48:11.259: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:48:11.260: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:48:11.484: INFO @decay_lr : LR updated to `0.0002813451` 2019-11-15 08:48:11.486: INFO @log_profile : T train: 44.032283 2019-11-15 08:48:11.486: INFO @log_profile : T valid: 1.482209 2019-11-15 08:48:11.486: INFO @log_profile : T read data: 66.481786 2019-11-15 08:48:11.486: INFO @log_profile : T hooks: 143.764217 2019-11-15 08:48:11.486: INFO @main_loop : Epoch 253 done 2019-11-15 08:48:11.486: INFO @main_loop : Training epoch 254 2019-11-15 08:50:08.442: INFO @log_variables: train loss nanmean: 0.040501 2019-11-15 08:50:08.442: INFO @log_variables: train positive_distance nanmean: 0.557679 2019-11-15 08:50:08.443: INFO @log_variables: train negative_distance nanmean: 1.419403 2019-11-15 08:50:08.443: INFO @log_variables: valid loss nanmean: 0.274611 2019-11-15 08:50:08.443: INFO @log_variables: valid positive_distance nanmean: 0.673047 2019-11-15 08:50:08.444: INFO @log_variables: valid negative_distance nanmean: 1.399730 2019-11-15 08:50:08.444: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:52:21.277: INFO @metrics_hook: train matching accuracy: 0.9920426801699973, N=110590, DB_SIZE=110592, N_IDS=7312 2019-11-15 08:52:22.462: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:52:22.645: INFO @evaluate_embedding: best threshold 1.0363885164260866 2019-11-15 08:52:22.726: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:52:22.726: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:52:22.950: INFO @decay_lr : LR updated to `0.00027993837` 2019-11-15 08:52:22.952: INFO @log_profile : T train: 43.949042 2019-11-15 08:52:22.952: INFO @log_profile : T valid: 1.475595 2019-11-15 08:52:22.952: INFO @log_profile : T read data: 62.829362 2019-11-15 08:52:22.952: INFO @log_profile : T hooks: 143.138810 2019-11-15 08:52:22.952: INFO @main_loop : Epoch 254 done 2019-11-15 08:52:22.952: INFO @main_loop : Training epoch 255 2019-11-15 08:54:12.048: INFO @log_variables: train loss nanmean: 0.039868 2019-11-15 08:54:12.049: INFO @log_variables: train positive_distance nanmean: 0.558536 2019-11-15 08:54:12.049: INFO @log_variables: train negative_distance nanmean: 1.419364 2019-11-15 08:54:12.049: INFO @log_variables: valid loss nanmean: 0.271506 2019-11-15 08:54:12.050: INFO @log_variables: valid positive_distance nanmean: 0.671547 2019-11-15 08:54:12.050: INFO @log_variables: valid negative_distance nanmean: 1.399374 2019-11-15 08:54:12.050: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 08:56:28.606: INFO @metrics_hook: train matching accuracy: 0.9928023726851852, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 08:56:29.744: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 08:56:29.926: INFO @evaluate_embedding: best threshold 1.035460740327835 2019-11-15 08:56:30.000: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 08:56:30.000: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 08:56:30.197: INFO @decay_lr : LR updated to `0.00027853868` 2019-11-15 08:56:30.199: INFO @log_profile : T train: 43.726332 2019-11-15 08:56:30.199: INFO @log_profile : T valid: 1.352969 2019-11-15 08:56:30.199: INFO @log_profile : T read data: 57.925481 2019-11-15 08:56:30.199: INFO @log_profile : T hooks: 144.168838 2019-11-15 08:56:30.199: INFO @main_loop : Epoch 255 done 2019-11-15 08:56:30.199: INFO @main_loop : Training epoch 256 2019-11-15 08:58:21.420: INFO @log_variables: train loss nanmean: 0.039534 2019-11-15 08:58:21.421: INFO @log_variables: train positive_distance nanmean: 0.557987 2019-11-15 08:58:21.421: INFO @log_variables: train negative_distance nanmean: 1.419355 2019-11-15 08:58:21.421: INFO @log_variables: valid loss nanmean: 0.274169 2019-11-15 08:58:21.421: INFO @log_variables: valid positive_distance nanmean: 0.672699 2019-11-15 08:58:21.421: INFO @log_variables: valid negative_distance nanmean: 1.399637 2019-11-15 08:58:21.421: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:00:32.748: INFO @metrics_hook: train matching accuracy: 0.9921151620370371, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-15 09:00:33.896: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:00:34.302: INFO @evaluate_embedding: best threshold 1.036168038845062 2019-11-15 09:00:34.427: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:00:34.427: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:00:34.923: INFO @decay_lr : LR updated to `0.00027714597` 2019-11-15 09:00:34.957: INFO @log_profile : T train: 43.790048 2019-11-15 09:00:34.957: INFO @log_profile : T valid: 1.365281 2019-11-15 09:00:34.957: INFO @log_profile : T read data: 60.363077 2019-11-15 09:00:34.957: INFO @log_profile : T hooks: 139.154854 2019-11-15 09:00:34.957: INFO @main_loop : Epoch 256 done 2019-11-15 09:00:34.957: INFO @main_loop : Training epoch 257 2019-11-15 09:02:29.184: INFO @log_variables: train loss nanmean: 0.038887 2019-11-15 09:02:29.185: INFO @log_variables: train positive_distance nanmean: 0.557101 2019-11-15 09:02:29.185: INFO @log_variables: train negative_distance nanmean: 1.419353 2019-11-15 09:02:29.185: INFO @log_variables: valid loss nanmean: 0.273415 2019-11-15 09:02:29.185: INFO @log_variables: valid positive_distance nanmean: 0.672413 2019-11-15 09:02:29.185: INFO @log_variables: valid negative_distance nanmean: 1.399210 2019-11-15 09:02:29.185: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:04:31.869: INFO @metrics_hook: train matching accuracy: 0.9922235986653525, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-15 09:04:33.152: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:04:33.409: INFO @evaluate_embedding: best threshold 1.0358114540576933 2019-11-15 09:04:33.612: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:04:33.612: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:04:34.204: INFO @decay_lr : LR updated to `0.00027576025` 2019-11-15 09:04:34.209: INFO @log_profile : T train: 43.906724 2019-11-15 09:04:34.210: INFO @log_profile : T valid: 1.397543 2019-11-15 09:04:34.211: INFO @log_profile : T read data: 62.530595 2019-11-15 09:04:34.211: INFO @log_profile : T hooks: 131.334193 2019-11-15 09:04:34.211: INFO @main_loop : Epoch 257 done 2019-11-15 09:04:34.211: INFO @main_loop : Training epoch 258 2019-11-15 09:07:02.767: INFO @log_variables: train loss nanmean: 0.040150 2019-11-15 09:07:02.768: INFO @log_variables: train positive_distance nanmean: 0.557788 2019-11-15 09:07:02.768: INFO @log_variables: train negative_distance nanmean: 1.419362 2019-11-15 09:07:02.768: INFO @log_variables: valid loss nanmean: 0.272117 2019-11-15 09:07:02.768: INFO @log_variables: valid positive_distance nanmean: 0.673845 2019-11-15 09:07:02.768: INFO @log_variables: valid negative_distance nanmean: 1.399768 2019-11-15 09:07:02.768: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:09:15.331: INFO @metrics_hook: train matching accuracy: 0.9923411489180856, N=110591, DB_SIZE=110592, N_IDS=7308 2019-11-15 09:09:16.345: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:09:16.529: INFO @evaluate_embedding: best threshold 1.0368063747882843 2019-11-15 09:09:16.616: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:09:16.616: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:09:16.824: INFO @decay_lr : LR updated to `0.00027438145` 2019-11-15 09:09:16.825: INFO @log_profile : T train: 102.407346 2019-11-15 09:09:16.825: INFO @log_profile : T valid: 1.612246 2019-11-15 09:09:16.826: INFO @log_profile : T read data: 36.461066 2019-11-15 09:09:16.826: INFO @log_profile : T hooks: 142.060497 2019-11-15 09:09:16.826: INFO @main_loop : Epoch 258 done 2019-11-15 09:09:16.826: INFO @main_loop : Training epoch 259 2019-11-15 09:11:06.112: INFO @log_variables: train loss nanmean: 0.037976 2019-11-15 09:11:06.113: INFO @log_variables: train positive_distance nanmean: 0.556774 2019-11-15 09:11:06.113: INFO @log_variables: train negative_distance nanmean: 1.419363 2019-11-15 09:11:06.113: INFO @log_variables: valid loss nanmean: 0.273113 2019-11-15 09:11:06.113: INFO @log_variables: valid positive_distance nanmean: 0.673050 2019-11-15 09:11:06.113: INFO @log_variables: valid negative_distance nanmean: 1.400058 2019-11-15 09:11:06.114: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:13:21.761: INFO @metrics_hook: train matching accuracy: 0.9929017732003509, N=110591, DB_SIZE=110592, N_IDS=7308 2019-11-15 09:13:22.797: INFO @metrics_hook: valid matching accuracy: 0.9860296470086382, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:13:23.012: INFO @evaluate_embedding: best threshold 1.036553978919983 2019-11-15 09:13:23.102: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:13:23.102: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:13:23.371: INFO @decay_lr : LR updated to `0.00027300956` 2019-11-15 09:13:23.373: INFO @log_profile : T train: 44.099279 2019-11-15 09:13:23.373: INFO @log_profile : T valid: 1.348157 2019-11-15 09:13:23.373: INFO @log_profile : T read data: 58.277942 2019-11-15 09:13:23.374: INFO @log_profile : T hooks: 142.727332 2019-11-15 09:13:23.374: INFO @main_loop : Epoch 259 done 2019-11-15 09:13:23.374: INFO @main_loop : Training epoch 260 2019-11-15 09:15:15.396: INFO @log_variables: train loss nanmean: 0.040464 2019-11-15 09:15:15.398: INFO @log_variables: train positive_distance nanmean: 0.558200 2019-11-15 09:15:15.398: INFO @log_variables: train negative_distance nanmean: 1.419345 2019-11-15 09:15:15.398: INFO @log_variables: valid loss nanmean: 0.272635 2019-11-15 09:15:15.398: INFO @log_variables: valid positive_distance nanmean: 0.671170 2019-11-15 09:15:15.398: INFO @log_variables: valid negative_distance nanmean: 1.400079 2019-11-15 09:15:15.398: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:17:25.667: INFO @metrics_hook: train matching accuracy: 0.9920609085648148, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 09:17:26.985: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:17:27.301: INFO @evaluate_embedding: best threshold 1.0356243550777435 2019-11-15 09:17:27.487: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:17:27.487: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:17:27.973: INFO @decay_lr : LR updated to `0.0002716445` 2019-11-15 09:17:27.979: INFO @log_profile : T train: 44.034701 2019-11-15 09:17:27.979: INFO @log_profile : T valid: 1.341456 2019-11-15 09:17:27.979: INFO @log_profile : T read data: 60.773324 2019-11-15 09:17:27.979: INFO @log_profile : T hooks: 138.382395 2019-11-15 09:17:27.980: INFO @main_loop : Epoch 260 done 2019-11-15 09:17:27.980: INFO @main_loop : Training epoch 261 2019-11-15 09:19:21.132: INFO @log_variables: train loss nanmean: 0.039438 2019-11-15 09:19:21.133: INFO @log_variables: train positive_distance nanmean: 0.557311 2019-11-15 09:19:21.133: INFO @log_variables: train negative_distance nanmean: 1.419370 2019-11-15 09:19:21.133: INFO @log_variables: valid loss nanmean: 0.277327 2019-11-15 09:19:21.133: INFO @log_variables: valid positive_distance nanmean: 0.673771 2019-11-15 09:19:21.133: INFO @log_variables: valid negative_distance nanmean: 1.400132 2019-11-15 09:19:21.133: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:21:37.591: INFO @metrics_hook: train matching accuracy: 0.9927481192129629, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 09:21:38.901: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:21:39.245: INFO @evaluate_embedding: best threshold 1.036951869726181 2019-11-15 09:21:39.378: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:21:39.378: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:21:39.968: INFO @decay_lr : LR updated to `0.00027028628` 2019-11-15 09:21:39.971: INFO @log_profile : T train: 43.993358 2019-11-15 09:21:39.971: INFO @log_profile : T valid: 1.411648 2019-11-15 09:21:39.971: INFO @log_profile : T read data: 61.557441 2019-11-15 09:21:39.971: INFO @log_profile : T hooks: 144.939719 2019-11-15 09:21:39.971: INFO @main_loop : Epoch 261 done 2019-11-15 09:21:39.972: INFO @main_loop : Training epoch 262 2019-11-15 09:23:37.154: INFO @log_variables: train loss nanmean: 0.040855 2019-11-15 09:23:37.155: INFO @log_variables: train positive_distance nanmean: 0.557912 2019-11-15 09:23:37.155: INFO @log_variables: train negative_distance nanmean: 1.419373 2019-11-15 09:23:37.155: INFO @log_variables: valid loss nanmean: 0.275498 2019-11-15 09:23:37.155: INFO @log_variables: valid positive_distance nanmean: 0.673259 2019-11-15 09:23:37.155: INFO @log_variables: valid negative_distance nanmean: 1.399684 2019-11-15 09:23:37.155: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:25:48.579: INFO @metrics_hook: train matching accuracy: 0.9929289641203703, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-15 09:25:49.930: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:25:50.337: INFO @evaluate_embedding: best threshold 1.0364714860916138 2019-11-15 09:25:50.527: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:25:50.527: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:25:51.197: INFO @decay_lr : LR updated to `0.00026893485` 2019-11-15 09:25:51.201: INFO @log_profile : T train: 43.835043 2019-11-15 09:25:51.201: INFO @log_profile : T valid: 1.375488 2019-11-15 09:25:51.201: INFO @log_profile : T read data: 65.910062 2019-11-15 09:25:51.201: INFO @log_profile : T hooks: 140.033765 2019-11-15 09:25:51.202: INFO @main_loop : Epoch 262 done 2019-11-15 09:25:51.202: INFO @main_loop : Training epoch 263 2019-11-15 09:27:51.218: INFO @log_variables: train loss nanmean: 0.039988 2019-11-15 09:27:51.219: INFO @log_variables: train positive_distance nanmean: 0.558336 2019-11-15 09:27:51.219: INFO @log_variables: train negative_distance nanmean: 1.419357 2019-11-15 09:27:51.219: INFO @log_variables: valid loss nanmean: 0.273262 2019-11-15 09:27:51.220: INFO @log_variables: valid positive_distance nanmean: 0.671312 2019-11-15 09:27:51.220: INFO @log_variables: valid negative_distance nanmean: 1.399344 2019-11-15 09:27:51.220: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:30:02.082: INFO @metrics_hook: train matching accuracy: 0.9927390769675926, N=110592, DB_SIZE=110592, N_IDS=7323 2019-11-15 09:30:03.304: INFO @metrics_hook: valid matching accuracy: 0.98816252532793, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:30:03.657: INFO @evaluate_embedding: best threshold 1.0353281795978548 2019-11-15 09:30:03.823: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:30:03.824: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:30:04.408: INFO @decay_lr : LR updated to `0.00026759016` 2019-11-15 09:30:04.410: INFO @log_profile : T train: 44.401359 2019-11-15 09:30:04.411: INFO @log_profile : T valid: 1.342606 2019-11-15 09:30:04.411: INFO @log_profile : T read data: 68.379952 2019-11-15 09:30:04.411: INFO @log_profile : T hooks: 138.990214 2019-11-15 09:30:04.411: INFO @main_loop : Epoch 263 done 2019-11-15 09:30:04.411: INFO @main_loop : Training epoch 264 2019-11-15 09:32:08.498: INFO @log_variables: train loss nanmean: 0.039010 2019-11-15 09:32:08.500: INFO @log_variables: train positive_distance nanmean: 0.557707 2019-11-15 09:32:08.500: INFO @log_variables: train negative_distance nanmean: 1.419350 2019-11-15 09:32:08.500: INFO @log_variables: valid loss nanmean: 0.272745 2019-11-15 09:32:08.500: INFO @log_variables: valid positive_distance nanmean: 0.671749 2019-11-15 09:32:08.500: INFO @log_variables: valid negative_distance nanmean: 1.400042 2019-11-15 09:32:08.500: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:34:17.405: INFO @metrics_hook: train matching accuracy: 0.9918167679398148, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 09:34:18.896: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:34:19.294: INFO @evaluate_embedding: best threshold 1.035895258188248 2019-11-15 09:34:19.493: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:34:19.493: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:34:20.133: INFO @decay_lr : LR updated to `0.0002662522` 2019-11-15 09:34:20.136: INFO @log_profile : T train: 44.408370 2019-11-15 09:34:20.136: INFO @log_profile : T valid: 1.390075 2019-11-15 09:34:20.136: INFO @log_profile : T read data: 72.170700 2019-11-15 09:34:20.136: INFO @log_profile : T hooks: 137.675226 2019-11-15 09:34:20.136: INFO @main_loop : Epoch 264 done 2019-11-15 09:34:20.136: INFO @main_loop : Training epoch 265 2019-11-15 09:36:25.661: INFO @log_variables: train loss nanmean: 0.039195 2019-11-15 09:36:25.664: INFO @log_variables: train positive_distance nanmean: 0.557644 2019-11-15 09:36:25.664: INFO @log_variables: train negative_distance nanmean: 1.419361 2019-11-15 09:36:25.664: INFO @log_variables: valid loss nanmean: 0.276511 2019-11-15 09:36:25.664: INFO @log_variables: valid positive_distance nanmean: 0.674677 2019-11-15 09:36:25.665: INFO @log_variables: valid negative_distance nanmean: 1.399617 2019-11-15 09:36:25.665: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:38:30.996: INFO @metrics_hook: train matching accuracy: 0.9918166939443536, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-15 09:38:32.123: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:38:32.438: INFO @evaluate_embedding: best threshold 1.0371468067169192 2019-11-15 09:38:32.610: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:38:32.610: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:38:33.273: INFO @decay_lr : LR updated to `0.00026492093` 2019-11-15 09:38:33.276: INFO @log_profile : T train: 44.512521 2019-11-15 09:38:33.276: INFO @log_profile : T valid: 1.368577 2019-11-15 09:38:33.276: INFO @log_profile : T read data: 73.737749 2019-11-15 09:38:33.276: INFO @log_profile : T hooks: 133.450157 2019-11-15 09:38:33.277: INFO @main_loop : Epoch 265 done 2019-11-15 09:38:33.277: INFO @main_loop : Training epoch 266 2019-11-15 09:40:43.760: INFO @log_variables: train loss nanmean: 0.039798 2019-11-15 09:40:43.761: INFO @log_variables: train positive_distance nanmean: 0.558271 2019-11-15 09:40:43.761: INFO @log_variables: train negative_distance nanmean: 1.419343 2019-11-15 09:40:43.761: INFO @log_variables: valid loss nanmean: 0.278913 2019-11-15 09:40:43.761: INFO @log_variables: valid positive_distance nanmean: 0.674087 2019-11-15 09:40:43.761: INFO @log_variables: valid negative_distance nanmean: 1.399572 2019-11-15 09:40:43.761: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:42:50.254: INFO @metrics_hook: train matching accuracy: 0.9927481192129629, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-15 09:42:51.661: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:42:51.981: INFO @evaluate_embedding: best threshold 1.0368296802043915 2019-11-15 09:42:52.183: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:42:52.183: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:42:52.730: INFO @decay_lr : LR updated to `0.00026359633` 2019-11-15 09:42:52.733: INFO @log_profile : T train: 44.812218 2019-11-15 09:42:52.733: INFO @log_profile : T valid: 1.404317 2019-11-15 09:42:52.733: INFO @log_profile : T read data: 77.976568 2019-11-15 09:42:52.733: INFO @log_profile : T hooks: 135.179940 2019-11-15 09:42:52.733: INFO @main_loop : Epoch 266 done 2019-11-15 09:42:52.733: INFO @main_loop : Training epoch 267 2019-11-15 09:45:04.362: INFO @log_variables: train loss nanmean: 0.038246 2019-11-15 09:45:04.363: INFO @log_variables: train positive_distance nanmean: 0.557449 2019-11-15 09:45:04.363: INFO @log_variables: train negative_distance nanmean: 1.419371 2019-11-15 09:45:04.363: INFO @log_variables: valid loss nanmean: 0.274172 2019-11-15 09:45:04.364: INFO @log_variables: valid positive_distance nanmean: 0.671383 2019-11-15 09:45:04.364: INFO @log_variables: valid negative_distance nanmean: 1.399879 2019-11-15 09:45:04.364: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:47:10.766: INFO @metrics_hook: train matching accuracy: 0.9928656038918175, N=110591, DB_SIZE=110592, N_IDS=7314 2019-11-15 09:47:11.936: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:47:12.388: INFO @evaluate_embedding: best threshold 1.0356309413909912 2019-11-15 09:47:12.537: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:47:12.537: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:47:13.065: INFO @decay_lr : LR updated to `0.00026227834` 2019-11-15 09:47:13.068: INFO @log_profile : T train: 44.596173 2019-11-15 09:47:13.068: INFO @log_profile : T valid: 1.521402 2019-11-15 09:47:13.068: INFO @log_profile : T read data: 79.451789 2019-11-15 09:47:13.069: INFO @log_profile : T hooks: 134.692583 2019-11-15 09:47:13.069: INFO @main_loop : Epoch 267 done 2019-11-15 09:47:13.069: INFO @main_loop : Training epoch 268 2019-11-15 09:49:27.925: INFO @log_variables: train loss nanmean: 0.038596 2019-11-15 09:49:27.936: INFO @log_variables: train positive_distance nanmean: 0.556718 2019-11-15 09:49:27.936: INFO @log_variables: train negative_distance nanmean: 1.419384 2019-11-15 09:49:27.936: INFO @log_variables: valid loss nanmean: 0.273922 2019-11-15 09:49:27.936: INFO @log_variables: valid positive_distance nanmean: 0.673701 2019-11-15 09:49:27.936: INFO @log_variables: valid negative_distance nanmean: 1.399351 2019-11-15 09:49:27.936: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:51:32.733: INFO @metrics_hook: train matching accuracy: 0.99188903256142, N=110591, DB_SIZE=110592, N_IDS=7312 2019-11-15 09:51:33.775: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:51:34.137: INFO @evaluate_embedding: best threshold 1.036525845527649 2019-11-15 09:51:34.282: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:51:34.282: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:51:34.862: INFO @decay_lr : LR updated to `0.00026096695` 2019-11-15 09:51:34.865: INFO @log_profile : T train: 44.416638 2019-11-15 09:51:34.865: INFO @log_profile : T valid: 1.377683 2019-11-15 09:51:34.865: INFO @log_profile : T read data: 82.976804 2019-11-15 09:51:34.865: INFO @log_profile : T hooks: 132.951452 2019-11-15 09:51:34.866: INFO @main_loop : Epoch 268 done 2019-11-15 09:51:34.866: INFO @main_loop : Training epoch 269 2019-11-15 09:53:51.652: INFO @log_variables: train loss nanmean: 0.039587 2019-11-15 09:53:51.654: INFO @log_variables: train positive_distance nanmean: 0.557482 2019-11-15 09:53:51.654: INFO @log_variables: train negative_distance nanmean: 1.419364 2019-11-15 09:53:51.654: INFO @log_variables: valid loss nanmean: 0.276799 2019-11-15 09:53:51.654: INFO @log_variables: valid positive_distance nanmean: 0.676064 2019-11-15 09:53:51.654: INFO @log_variables: valid negative_distance nanmean: 1.399470 2019-11-15 09:53:51.654: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 09:55:53.782: INFO @metrics_hook: train matching accuracy: 0.9924676733881906, N=110590, DB_SIZE=110592, N_IDS=7312 2019-11-15 09:55:55.141: INFO @metrics_hook: valid matching accuracy: 0.9879492374960008, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 09:55:55.585: INFO @evaluate_embedding: best threshold 1.0377672016620636 2019-11-15 09:55:55.759: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 09:55:55.759: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 09:55:56.335: INFO @decay_lr : LR updated to `0.0002596621` 2019-11-15 09:55:56.340: INFO @log_profile : T train: 44.521477 2019-11-15 09:55:56.340: INFO @log_profile : T valid: 1.374413 2019-11-15 09:55:56.340: INFO @log_profile : T read data: 84.305972 2019-11-15 09:55:56.340: INFO @log_profile : T hooks: 131.192677 2019-11-15 09:55:56.340: INFO @main_loop : Epoch 269 done 2019-11-15 09:55:56.341: INFO @main_loop : Training epoch 270 2019-11-15 09:58:18.163: INFO @log_variables: train loss nanmean: 0.038524 2019-11-15 09:58:18.164: INFO @log_variables: train positive_distance nanmean: 0.556992 2019-11-15 09:58:18.165: INFO @log_variables: train negative_distance nanmean: 1.419374 2019-11-15 09:58:18.165: INFO @log_variables: valid loss nanmean: 0.274645 2019-11-15 09:58:18.165: INFO @log_variables: valid positive_distance nanmean: 0.672474 2019-11-15 09:58:18.165: INFO @log_variables: valid negative_distance nanmean: 1.399525 2019-11-15 09:58:18.165: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:00:22.767: INFO @metrics_hook: train matching accuracy: 0.9918166939443536, N=110591, DB_SIZE=110592, N_IDS=7317 2019-11-15 10:00:24.139: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:00:24.555: INFO @evaluate_embedding: best threshold 1.0359992682933807 2019-11-15 10:00:24.752: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:00:24.752: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:00:25.294: INFO @decay_lr : LR updated to `0.00025836378` 2019-11-15 10:00:25.295: INFO @log_profile : T train: 45.018097 2019-11-15 10:00:25.295: INFO @log_profile : T valid: 1.393397 2019-11-15 10:00:25.296: INFO @log_profile : T read data: 89.489605 2019-11-15 10:00:25.296: INFO @log_profile : T hooks: 132.970153 2019-11-15 10:00:25.296: INFO @main_loop : Epoch 270 done 2019-11-15 10:00:25.296: INFO @main_loop : Training epoch 271 2019-11-15 10:02:48.117: INFO @log_variables: train loss nanmean: 0.039100 2019-11-15 10:02:48.118: INFO @log_variables: train positive_distance nanmean: 0.557921 2019-11-15 10:02:48.118: INFO @log_variables: train negative_distance nanmean: 1.419372 2019-11-15 10:02:48.118: INFO @log_variables: valid loss nanmean: 0.274729 2019-11-15 10:02:48.118: INFO @log_variables: valid positive_distance nanmean: 0.674864 2019-11-15 10:02:48.118: INFO @log_variables: valid negative_distance nanmean: 1.399882 2019-11-15 10:02:48.118: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:04:50.883: INFO @metrics_hook: train matching accuracy: 0.993516651445416, N=110591, DB_SIZE=110592, N_IDS=7320 2019-11-15 10:04:51.940: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:04:52.373: INFO @evaluate_embedding: best threshold 1.0373732745647428 2019-11-15 10:04:52.518: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:04:52.518: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:04:53.069: INFO @decay_lr : LR updated to `0.00025707195` 2019-11-15 10:04:53.085: INFO @log_profile : T train: 45.555262 2019-11-15 10:04:53.085: INFO @log_profile : T valid: 1.389248 2019-11-15 10:04:53.099: INFO @log_profile : T read data: 89.726401 2019-11-15 10:04:53.099: INFO @log_profile : T hooks: 131.031058 2019-11-15 10:04:53.099: INFO @main_loop : Epoch 271 done 2019-11-15 10:04:53.099: INFO @main_loop : Training epoch 272 2019-11-15 10:07:18.340: INFO @log_variables: train loss nanmean: 0.038550 2019-11-15 10:07:18.341: INFO @log_variables: train positive_distance nanmean: 0.557795 2019-11-15 10:07:18.341: INFO @log_variables: train negative_distance nanmean: 1.419382 2019-11-15 10:07:18.341: INFO @log_variables: valid loss nanmean: 0.274970 2019-11-15 10:07:18.341: INFO @log_variables: valid positive_distance nanmean: 0.674586 2019-11-15 10:07:18.341: INFO @log_variables: valid negative_distance nanmean: 1.399841 2019-11-15 10:07:18.341: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:09:18.601: INFO @metrics_hook: train matching accuracy: 0.9929289001817507, N=110591, DB_SIZE=110592, N_IDS=7303 2019-11-15 10:09:19.828: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:09:20.177: INFO @evaluate_embedding: best threshold 1.0372134447097778 2019-11-15 10:09:20.337: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:09:20.338: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:09:20.751: INFO @decay_lr : LR updated to `0.00025578658` 2019-11-15 10:09:20.756: INFO @log_profile : T train: 45.032415 2019-11-15 10:09:20.756: INFO @log_profile : T valid: 1.389193 2019-11-15 10:09:20.756: INFO @log_profile : T read data: 92.744313 2019-11-15 10:09:20.756: INFO @log_profile : T hooks: 128.391732 2019-11-15 10:09:20.756: INFO @main_loop : Epoch 272 done 2019-11-15 10:09:20.756: INFO @main_loop : Training epoch 273 2019-11-15 10:13:58.038: INFO @log_variables: train loss nanmean: 0.038854 2019-11-15 10:13:58.039: INFO @log_variables: train positive_distance nanmean: 0.556378 2019-11-15 10:13:58.039: INFO @log_variables: train negative_distance nanmean: 1.419378 2019-11-15 10:13:58.039: INFO @log_variables: valid loss nanmean: 0.271282 2019-11-15 10:13:58.039: INFO @log_variables: valid positive_distance nanmean: 0.674773 2019-11-15 10:13:58.039: INFO @log_variables: valid negative_distance nanmean: 1.400344 2019-11-15 10:13:58.039: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:16:16.039: INFO @metrics_hook: train matching accuracy: 0.9925401475694444, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 10:16:17.287: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:16:17.562: INFO @evaluate_embedding: best threshold 1.037558764219284 2019-11-15 10:16:17.701: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:16:17.701: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:16:18.086: INFO @decay_lr : LR updated to `0.00025450764` 2019-11-15 10:16:18.088: INFO @log_profile : T train: 164.933255 2019-11-15 10:16:18.088: INFO @log_profile : T valid: 1.353054 2019-11-15 10:16:18.089: INFO @log_profile : T read data: 104.134976 2019-11-15 10:16:18.089: INFO @log_profile : T hooks: 146.821104 2019-11-15 10:16:18.089: INFO @main_loop : Epoch 273 done 2019-11-15 10:16:18.089: INFO @main_loop : Training epoch 274 2019-11-15 10:18:27.840: INFO @log_variables: train loss nanmean: 0.038516 2019-11-15 10:18:27.840: INFO @log_variables: train positive_distance nanmean: 0.557258 2019-11-15 10:18:27.840: INFO @log_variables: train negative_distance nanmean: 1.419370 2019-11-15 10:18:27.840: INFO @log_variables: valid loss nanmean: 0.273181 2019-11-15 10:18:27.840: INFO @log_variables: valid positive_distance nanmean: 0.672568 2019-11-15 10:18:27.840: INFO @log_variables: valid negative_distance nanmean: 1.400204 2019-11-15 10:18:27.840: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:20:31.393: INFO @metrics_hook: train matching accuracy: 0.9920518663194444, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 10:20:32.487: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:20:32.696: INFO @evaluate_embedding: best threshold 1.0363861620426178 2019-11-15 10:20:32.795: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:20:32.795: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:20:33.031: INFO @decay_lr : LR updated to `0.0002532351` 2019-11-15 10:20:33.033: INFO @log_profile : T train: 44.829903 2019-11-15 10:20:33.033: INFO @log_profile : T valid: 1.373489 2019-11-15 10:20:33.033: INFO @log_profile : T read data: 77.573881 2019-11-15 10:20:33.033: INFO @log_profile : T hooks: 131.092137 2019-11-15 10:20:33.033: INFO @main_loop : Epoch 274 done 2019-11-15 10:20:33.033: INFO @main_loop : Training epoch 275 2019-11-15 10:22:40.372: INFO @log_variables: train loss nanmean: 0.040060 2019-11-15 10:22:40.372: INFO @log_variables: train positive_distance nanmean: 0.558492 2019-11-15 10:22:40.372: INFO @log_variables: train negative_distance nanmean: 1.419351 2019-11-15 10:22:40.372: INFO @log_variables: valid loss nanmean: 0.274241 2019-11-15 10:22:40.372: INFO @log_variables: valid positive_distance nanmean: 0.672000 2019-11-15 10:22:40.372: INFO @log_variables: valid negative_distance nanmean: 1.399781 2019-11-15 10:22:40.372: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:24:56.499: INFO @metrics_hook: train matching accuracy: 0.9923411489180856, N=110591, DB_SIZE=110592, N_IDS=7306 2019-11-15 10:24:57.839: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:24:58.093: INFO @evaluate_embedding: best threshold 1.035890132188797 2019-11-15 10:24:58.196: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:24:58.196: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:24:58.565: INFO @decay_lr : LR updated to `0.00025196894` 2019-11-15 10:24:58.567: INFO @log_profile : T train: 45.229676 2019-11-15 10:24:58.567: INFO @log_profile : T valid: 1.385067 2019-11-15 10:24:58.567: INFO @log_profile : T read data: 74.665260 2019-11-15 10:24:58.567: INFO @log_profile : T hooks: 144.180824 2019-11-15 10:24:58.567: INFO @main_loop : Epoch 275 done 2019-11-15 10:24:58.567: INFO @main_loop : Training epoch 276 2019-11-15 10:27:08.219: INFO @log_variables: train loss nanmean: 0.038813 2019-11-15 10:27:08.219: INFO @log_variables: train positive_distance nanmean: 0.557515 2019-11-15 10:27:08.219: INFO @log_variables: train negative_distance nanmean: 1.419371 2019-11-15 10:27:08.219: INFO @log_variables: valid loss nanmean: 0.276951 2019-11-15 10:27:08.219: INFO @log_variables: valid positive_distance nanmean: 0.670578 2019-11-15 10:27:08.219: INFO @log_variables: valid negative_distance nanmean: 1.399318 2019-11-15 10:27:08.220: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:29:20.657: INFO @metrics_hook: train matching accuracy: 0.9922779224537037, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 10:29:22.065: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:29:22.432: INFO @evaluate_embedding: best threshold 1.0349483489990232 2019-11-15 10:29:22.609: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:29:22.609: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:29:23.005: INFO @decay_lr : LR updated to `0.0002507091` 2019-11-15 10:29:23.006: INFO @log_profile : T train: 45.171068 2019-11-15 10:29:23.007: INFO @log_profile : T valid: 1.369331 2019-11-15 10:29:23.007: INFO @log_profile : T read data: 77.221119 2019-11-15 10:29:23.007: INFO @log_profile : T hooks: 140.604828 2019-11-15 10:29:23.007: INFO @main_loop : Epoch 276 done 2019-11-15 10:29:23.007: INFO @main_loop : Training epoch 277 2019-11-15 10:31:37.026: INFO @log_variables: train loss nanmean: 0.038050 2019-11-15 10:31:37.026: INFO @log_variables: train positive_distance nanmean: 0.556664 2019-11-15 10:31:37.027: INFO @log_variables: train negative_distance nanmean: 1.419395 2019-11-15 10:31:37.027: INFO @log_variables: valid loss nanmean: 0.273746 2019-11-15 10:31:37.027: INFO @log_variables: valid positive_distance nanmean: 0.674189 2019-11-15 10:31:37.027: INFO @log_variables: valid negative_distance nanmean: 1.400367 2019-11-15 10:31:37.027: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:33:52.073: INFO @metrics_hook: train matching accuracy: 0.9915635850694444, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 10:33:53.423: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:33:53.623: INFO @evaluate_embedding: best threshold 1.037277936935425 2019-11-15 10:33:53.707: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:33:53.707: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:33:53.935: INFO @decay_lr : LR updated to `0.00024945557` 2019-11-15 10:33:53.937: INFO @log_profile : T train: 45.443502 2019-11-15 10:33:53.937: INFO @log_profile : T valid: 1.387244 2019-11-15 10:33:53.937: INFO @log_profile : T read data: 81.047156 2019-11-15 10:33:53.937: INFO @log_profile : T hooks: 142.982888 2019-11-15 10:33:53.938: INFO @main_loop : Epoch 277 done 2019-11-15 10:33:53.938: INFO @main_loop : Training epoch 278 2019-11-15 10:36:09.662: INFO @log_variables: train loss nanmean: 0.037947 2019-11-15 10:36:09.662: INFO @log_variables: train positive_distance nanmean: 0.556387 2019-11-15 10:36:09.662: INFO @log_variables: train negative_distance nanmean: 1.419385 2019-11-15 10:36:09.662: INFO @log_variables: valid loss nanmean: 0.273846 2019-11-15 10:36:09.662: INFO @log_variables: valid positive_distance nanmean: 0.673800 2019-11-15 10:36:09.662: INFO @log_variables: valid negative_distance nanmean: 1.400246 2019-11-15 10:36:09.662: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:38:22.399: INFO @metrics_hook: train matching accuracy: 0.9916991436916205, N=110591, DB_SIZE=110592, N_IDS=7302 2019-11-15 10:38:23.536: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:38:23.790: INFO @evaluate_embedding: best threshold 1.0370228588581085 2019-11-15 10:38:24.007: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:38:24.007: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:38:24.266: INFO @decay_lr : LR updated to `0.0002482083` 2019-11-15 10:38:24.268: INFO @log_profile : T train: 45.384801 2019-11-15 10:38:24.268: INFO @log_profile : T valid: 1.384543 2019-11-15 10:38:24.268: INFO @log_profile : T read data: 82.950783 2019-11-15 10:38:24.268: INFO @log_profile : T hooks: 140.538978 2019-11-15 10:38:24.268: INFO @main_loop : Epoch 278 done 2019-11-15 10:38:24.268: INFO @main_loop : Training epoch 279 2019-11-15 10:40:38.127: INFO @log_variables: train loss nanmean: 0.039069 2019-11-15 10:40:38.127: INFO @log_variables: train positive_distance nanmean: 0.558111 2019-11-15 10:40:38.128: INFO @log_variables: train negative_distance nanmean: 1.419392 2019-11-15 10:40:38.128: INFO @log_variables: valid loss nanmean: 0.276012 2019-11-15 10:40:38.128: INFO @log_variables: valid positive_distance nanmean: 0.675539 2019-11-15 10:40:38.128: INFO @log_variables: valid negative_distance nanmean: 1.399999 2019-11-15 10:40:38.128: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:42:55.447: INFO @metrics_hook: train matching accuracy: 0.9926033095216565, N=110590, DB_SIZE=110592, N_IDS=7316 2019-11-15 10:42:56.542: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:42:56.781: INFO @evaluate_embedding: best threshold 1.0377688407897951 2019-11-15 10:42:56.929: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:42:56.929: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:42:57.190: INFO @decay_lr : LR updated to `0.00024696725` 2019-11-15 10:42:57.192: INFO @log_profile : T train: 45.486257 2019-11-15 10:42:57.192: INFO @log_profile : T valid: 1.335227 2019-11-15 10:42:57.192: INFO @log_profile : T read data: 81.208007 2019-11-15 10:42:57.192: INFO @log_profile : T hooks: 144.822192 2019-11-15 10:42:57.192: INFO @main_loop : Epoch 279 done 2019-11-15 10:42:57.193: INFO @main_loop : Training epoch 280 2019-11-15 10:45:16.527: INFO @log_variables: train loss nanmean: 0.038077 2019-11-15 10:45:16.527: INFO @log_variables: train positive_distance nanmean: 0.556697 2019-11-15 10:45:16.527: INFO @log_variables: train negative_distance nanmean: 1.419372 2019-11-15 10:45:16.527: INFO @log_variables: valid loss nanmean: 0.273934 2019-11-15 10:45:16.528: INFO @log_variables: valid positive_distance nanmean: 0.674913 2019-11-15 10:45:16.528: INFO @log_variables: valid negative_distance nanmean: 1.399961 2019-11-15 10:45:16.528: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:47:29.840: INFO @metrics_hook: train matching accuracy: 0.9926215277777778, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 10:47:31.019: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:47:31.270: INFO @evaluate_embedding: best threshold 1.0374368727207182 2019-11-15 10:47:31.441: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:47:31.442: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:47:31.755: INFO @decay_lr : LR updated to `0.0002457324` 2019-11-15 10:47:31.757: INFO @log_profile : T train: 45.121767 2019-11-15 10:47:31.757: INFO @log_profile : T valid: 1.402137 2019-11-15 10:47:31.757: INFO @log_profile : T read data: 86.345181 2019-11-15 10:47:31.757: INFO @log_profile : T hooks: 141.619491 2019-11-15 10:47:31.757: INFO @main_loop : Epoch 280 done 2019-11-15 10:47:31.757: INFO @main_loop : Training epoch 281 2019-11-15 10:49:52.651: INFO @log_variables: train loss nanmean: 0.037485 2019-11-15 10:49:52.652: INFO @log_variables: train positive_distance nanmean: 0.556708 2019-11-15 10:49:52.652: INFO @log_variables: train negative_distance nanmean: 1.419380 2019-11-15 10:49:52.652: INFO @log_variables: valid loss nanmean: 0.275799 2019-11-15 10:49:52.652: INFO @log_variables: valid positive_distance nanmean: 0.673224 2019-11-15 10:49:52.652: INFO @log_variables: valid negative_distance nanmean: 1.400059 2019-11-15 10:49:52.652: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:52:13.640: INFO @metrics_hook: train matching accuracy: 0.9920246674684197, N=110591, DB_SIZE=110592, N_IDS=7313 2019-11-15 10:52:15.083: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:52:15.266: INFO @evaluate_embedding: best threshold 1.0366411805152895 2019-11-15 10:52:15.390: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:52:15.390: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:52:15.616: INFO @decay_lr : LR updated to `0.00024450372` 2019-11-15 10:52:15.617: INFO @log_profile : T train: 46.026420 2019-11-15 10:52:15.617: INFO @log_profile : T valid: 1.355144 2019-11-15 10:52:15.617: INFO @log_profile : T read data: 87.228868 2019-11-15 10:52:15.618: INFO @log_profile : T hooks: 149.180176 2019-11-15 10:52:15.618: INFO @main_loop : Epoch 281 done 2019-11-15 10:52:15.618: INFO @main_loop : Training epoch 282 2019-11-15 10:54:51.596: INFO @log_variables: train loss nanmean: 0.038779 2019-11-15 10:54:51.596: INFO @log_variables: train positive_distance nanmean: 0.557248 2019-11-15 10:54:51.596: INFO @log_variables: train negative_distance nanmean: 1.419382 2019-11-15 10:54:51.596: INFO @log_variables: valid loss nanmean: 0.273633 2019-11-15 10:54:51.596: INFO @log_variables: valid positive_distance nanmean: 0.671077 2019-11-15 10:54:51.596: INFO @log_variables: valid negative_distance nanmean: 1.399458 2019-11-15 10:54:51.596: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 10:57:21.825: INFO @metrics_hook: train matching accuracy: 0.9921875, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-15 10:57:23.366: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 10:57:23.574: INFO @evaluate_embedding: best threshold 1.0352677702903748 2019-11-15 10:57:23.663: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 10:57:23.663: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 10:57:24.019: INFO @decay_lr : LR updated to `0.0002432812` 2019-11-15 10:57:24.021: INFO @log_profile : T train: 46.027621 2019-11-15 10:57:24.021: INFO @log_profile : T valid: 1.396065 2019-11-15 10:57:24.021: INFO @log_profile : T read data: 102.468692 2019-11-15 10:57:24.021: INFO @log_profile : T hooks: 158.432013 2019-11-15 10:57:24.021: INFO @main_loop : Epoch 282 done 2019-11-15 10:57:24.021: INFO @main_loop : Training epoch 283 2019-11-15 11:00:03.673: INFO @log_variables: train loss nanmean: 0.038188 2019-11-15 11:00:03.673: INFO @log_variables: train positive_distance nanmean: 0.556590 2019-11-15 11:00:03.673: INFO @log_variables: train negative_distance nanmean: 1.419375 2019-11-15 11:00:03.673: INFO @log_variables: valid loss nanmean: 0.272071 2019-11-15 11:00:03.673: INFO @log_variables: valid positive_distance nanmean: 0.672706 2019-11-15 11:00:03.673: INFO @log_variables: valid negative_distance nanmean: 1.399640 2019-11-15 11:00:03.674: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:02:17.717: INFO @metrics_hook: train matching accuracy: 0.9927119502314815, N=110592, DB_SIZE=110592, N_IDS=7298 2019-11-15 11:02:18.723: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:02:18.888: INFO @evaluate_embedding: best threshold 1.0361731946468355 2019-11-15 11:02:18.957: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:02:18.957: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:02:19.129: INFO @decay_lr : LR updated to `0.0002420648` 2019-11-15 11:02:19.130: INFO @log_profile : T train: 47.112978 2019-11-15 11:02:19.130: INFO @log_profile : T valid: 1.422363 2019-11-15 11:02:19.130: INFO @log_profile : T read data: 104.612766 2019-11-15 11:02:19.130: INFO @log_profile : T hooks: 141.881810 2019-11-15 11:02:19.131: INFO @main_loop : Epoch 283 done 2019-11-15 11:02:19.131: INFO @main_loop : Training epoch 284 2019-11-15 11:04:51.257: INFO @log_variables: train loss nanmean: 0.038522 2019-11-15 11:04:51.257: INFO @log_variables: train positive_distance nanmean: 0.557243 2019-11-15 11:04:51.257: INFO @log_variables: train negative_distance nanmean: 1.419366 2019-11-15 11:04:51.257: INFO @log_variables: valid loss nanmean: 0.273532 2019-11-15 11:04:51.257: INFO @log_variables: valid positive_distance nanmean: 0.672365 2019-11-15 11:04:51.257: INFO @log_variables: valid negative_distance nanmean: 1.399593 2019-11-15 11:04:51.257: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:07:06.520: INFO @metrics_hook: train matching accuracy: 0.9920969346233837, N=110590, DB_SIZE=110592, N_IDS=7310 2019-11-15 11:07:07.841: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:07:08.035: INFO @evaluate_embedding: best threshold 1.0359787642955778 2019-11-15 11:07:08.168: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:07:08.168: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:07:08.440: INFO @decay_lr : LR updated to `0.00024085447` 2019-11-15 11:07:08.442: INFO @log_profile : T train: 46.655414 2019-11-15 11:07:08.442: INFO @log_profile : T valid: 1.376049 2019-11-15 11:07:08.442: INFO @log_profile : T read data: 97.954748 2019-11-15 11:07:08.442: INFO @log_profile : T hooks: 143.247925 2019-11-15 11:07:08.442: INFO @main_loop : Epoch 284 done 2019-11-15 11:07:08.443: INFO @main_loop : Training epoch 285 2019-11-15 11:09:36.225: INFO @log_variables: train loss nanmean: 0.038883 2019-11-15 11:09:36.225: INFO @log_variables: train positive_distance nanmean: 0.557371 2019-11-15 11:09:36.225: INFO @log_variables: train negative_distance nanmean: 1.419371 2019-11-15 11:09:36.226: INFO @log_variables: valid loss nanmean: 0.271732 2019-11-15 11:09:36.226: INFO @log_variables: valid positive_distance nanmean: 0.672997 2019-11-15 11:09:36.226: INFO @log_variables: valid negative_distance nanmean: 1.400199 2019-11-15 11:09:36.226: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:11:52.355: INFO @metrics_hook: train matching accuracy: 0.9925401475694444, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 11:11:53.733: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:11:53.915: INFO @evaluate_embedding: best threshold 1.0365981459617615 2019-11-15 11:11:53.996: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:11:53.996: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:11:54.206: INFO @decay_lr : LR updated to `0.0002396502` 2019-11-15 11:11:54.207: INFO @log_profile : T train: 45.982815 2019-11-15 11:11:54.207: INFO @log_profile : T valid: 1.376725 2019-11-15 11:11:54.207: INFO @log_profile : T read data: 94.402668 2019-11-15 11:11:54.207: INFO @log_profile : T hooks: 143.925965 2019-11-15 11:11:54.207: INFO @main_loop : Epoch 285 done 2019-11-15 11:11:54.207: INFO @main_loop : Training epoch 286 2019-11-15 11:14:22.971: INFO @log_variables: train loss nanmean: 0.037195 2019-11-15 11:14:22.971: INFO @log_variables: train positive_distance nanmean: 0.556051 2019-11-15 11:14:22.972: INFO @log_variables: train negative_distance nanmean: 1.419398 2019-11-15 11:14:22.972: INFO @log_variables: valid loss nanmean: 0.273190 2019-11-15 11:14:22.972: INFO @log_variables: valid positive_distance nanmean: 0.673198 2019-11-15 11:14:22.972: INFO @log_variables: valid negative_distance nanmean: 1.400019 2019-11-15 11:14:22.972: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:16:41.804: INFO @metrics_hook: train matching accuracy: 0.9930284288194444, N=110592, DB_SIZE=110592, N_IDS=7320 2019-11-15 11:16:43.008: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:16:43.169: INFO @evaluate_embedding: best threshold 1.0366084277629852 2019-11-15 11:16:43.236: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:16:43.236: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:16:43.420: INFO @decay_lr : LR updated to `0.00023845195` 2019-11-15 11:16:43.422: INFO @log_profile : T train: 52.558386 2019-11-15 11:16:43.422: INFO @log_profile : T valid: 1.363234 2019-11-15 11:16:43.422: INFO @log_profile : T read data: 88.798284 2019-11-15 11:16:43.422: INFO @log_profile : T hooks: 146.421291 2019-11-15 11:16:43.422: INFO @main_loop : Epoch 286 done 2019-11-15 11:16:43.422: INFO @main_loop : Training epoch 287 2019-11-15 11:19:14.190: INFO @log_variables: train loss nanmean: 0.037701 2019-11-15 11:19:14.190: INFO @log_variables: train positive_distance nanmean: 0.557105 2019-11-15 11:19:14.190: INFO @log_variables: train negative_distance nanmean: 1.419382 2019-11-15 11:19:14.190: INFO @log_variables: valid loss nanmean: 0.274715 2019-11-15 11:19:14.190: INFO @log_variables: valid positive_distance nanmean: 0.674174 2019-11-15 11:19:14.191: INFO @log_variables: valid negative_distance nanmean: 1.400075 2019-11-15 11:19:14.191: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:21:32.652: INFO @metrics_hook: train matching accuracy: 0.9919793833077132, N=110590, DB_SIZE=110592, N_IDS=7310 2019-11-15 11:21:33.691: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:21:33.857: INFO @evaluate_embedding: best threshold 1.037124127149582 2019-11-15 11:21:33.921: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:21:33.921: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:21:34.124: INFO @decay_lr : LR updated to `0.0002372597` 2019-11-15 11:21:34.125: INFO @log_profile : T train: 46.270528 2019-11-15 11:21:34.126: INFO @log_profile : T valid: 1.338855 2019-11-15 11:21:34.126: INFO @log_profile : T read data: 97.588467 2019-11-15 11:21:34.126: INFO @log_profile : T hooks: 145.429882 2019-11-15 11:21:34.126: INFO @main_loop : Epoch 287 done 2019-11-15 11:21:34.126: INFO @main_loop : Training epoch 288 2019-11-15 11:24:01.047: INFO @log_variables: train loss nanmean: 0.038110 2019-11-15 11:24:01.048: INFO @log_variables: train positive_distance nanmean: 0.557257 2019-11-15 11:24:01.048: INFO @log_variables: train negative_distance nanmean: 1.419370 2019-11-15 11:24:01.050: INFO @log_variables: valid loss nanmean: 0.275670 2019-11-15 11:24:01.050: INFO @log_variables: valid positive_distance nanmean: 0.674889 2019-11-15 11:24:01.050: INFO @log_variables: valid negative_distance nanmean: 1.399653 2019-11-15 11:24:01.051: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:26:17.365: INFO @metrics_hook: train matching accuracy: 0.9924496568436852, N=110591, DB_SIZE=110592, N_IDS=7300 2019-11-15 11:26:18.657: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:26:18.859: INFO @evaluate_embedding: best threshold 1.0372706651687622 2019-11-15 11:26:18.944: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:26:18.944: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:26:19.149: INFO @decay_lr : LR updated to `0.00023607339` 2019-11-15 11:26:19.150: INFO @log_profile : T train: 45.710306 2019-11-15 11:26:19.150: INFO @log_profile : T valid: 1.385492 2019-11-15 11:26:19.150: INFO @log_profile : T read data: 91.303682 2019-11-15 11:26:19.150: INFO @log_profile : T hooks: 146.551169 2019-11-15 11:26:19.151: INFO @main_loop : Epoch 288 done 2019-11-15 11:26:19.151: INFO @main_loop : Training epoch 289 2019-11-15 11:28:40.816: INFO @log_variables: train loss nanmean: 0.037893 2019-11-15 11:28:40.817: INFO @log_variables: train positive_distance nanmean: 0.556935 2019-11-15 11:28:40.817: INFO @log_variables: train negative_distance nanmean: 1.419354 2019-11-15 11:28:40.817: INFO @log_variables: valid loss nanmean: 0.273889 2019-11-15 11:28:40.817: INFO @log_variables: valid positive_distance nanmean: 0.673873 2019-11-15 11:28:40.817: INFO @log_variables: valid negative_distance nanmean: 1.400193 2019-11-15 11:28:40.818: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:30:56.985: INFO @metrics_hook: train matching accuracy: 0.9922960069444444, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 11:30:58.467: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:30:58.673: INFO @evaluate_embedding: best threshold 1.0370329320430756 2019-11-15 11:30:58.750: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:30:58.750: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:30:58.988: INFO @decay_lr : LR updated to `0.00023489303` 2019-11-15 11:30:58.990: INFO @log_profile : T train: 45.407254 2019-11-15 11:30:58.990: INFO @log_profile : T valid: 1.391107 2019-11-15 11:30:58.990: INFO @log_profile : T read data: 86.598082 2019-11-15 11:30:58.990: INFO @log_profile : T hooks: 146.374595 2019-11-15 11:30:58.990: INFO @main_loop : Epoch 289 done 2019-11-15 11:30:58.990: INFO @main_loop : Training epoch 290 2019-11-15 11:33:18.660: INFO @log_variables: train loss nanmean: 0.037849 2019-11-15 11:33:18.661: INFO @log_variables: train positive_distance nanmean: 0.556985 2019-11-15 11:33:18.661: INFO @log_variables: train negative_distance nanmean: 1.419387 2019-11-15 11:33:18.661: INFO @log_variables: valid loss nanmean: 0.271901 2019-11-15 11:33:18.661: INFO @log_variables: valid positive_distance nanmean: 0.673993 2019-11-15 11:33:18.662: INFO @log_variables: valid negative_distance nanmean: 1.399829 2019-11-15 11:33:18.662: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:35:36.893: INFO @metrics_hook: train matching accuracy: 0.9920428240740741, N=110592, DB_SIZE=110592, N_IDS=7303 2019-11-15 11:35:38.047: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:35:38.218: INFO @evaluate_embedding: best threshold 1.0369108021259308 2019-11-15 11:35:38.296: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:35:38.296: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:35:38.524: INFO @decay_lr : LR updated to `0.00023371856` 2019-11-15 11:35:38.526: INFO @log_profile : T train: 45.550458 2019-11-15 11:35:38.526: INFO @log_profile : T valid: 1.427715 2019-11-15 11:35:38.527: INFO @log_profile : T read data: 84.429675 2019-11-15 11:35:38.527: INFO @log_profile : T hooks: 148.055883 2019-11-15 11:35:38.527: INFO @main_loop : Epoch 290 done 2019-11-15 11:35:38.527: INFO @main_loop : Training epoch 291 2019-11-15 11:37:58.694: INFO @log_variables: train loss nanmean: 0.037990 2019-11-15 11:37:58.695: INFO @log_variables: train positive_distance nanmean: 0.556985 2019-11-15 11:37:58.695: INFO @log_variables: train negative_distance nanmean: 1.419384 2019-11-15 11:37:58.695: INFO @log_variables: valid loss nanmean: 0.274196 2019-11-15 11:37:58.695: INFO @log_variables: valid positive_distance nanmean: 0.675510 2019-11-15 11:37:58.695: INFO @log_variables: valid negative_distance nanmean: 1.399870 2019-11-15 11:37:58.696: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:40:12.721: INFO @metrics_hook: train matching accuracy: 0.9927752459490741, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 11:40:14.109: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:40:16.467: INFO @evaluate_embedding: best threshold 1.0376902818679812 2019-11-15 11:40:16.538: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:40:16.538: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:40:16.797: INFO @decay_lr : LR updated to `0.00023254997` 2019-11-15 11:40:16.799: INFO @log_profile : T train: 44.955456 2019-11-15 11:40:16.799: INFO @log_profile : T valid: 1.378163 2019-11-15 11:40:16.799: INFO @log_profile : T read data: 85.889890 2019-11-15 11:40:16.799: INFO @log_profile : T hooks: 145.978458 2019-11-15 11:40:16.799: INFO @main_loop : Epoch 291 done 2019-11-15 11:40:16.799: INFO @main_loop : Training epoch 292 2019-11-15 11:42:30.422: INFO @log_variables: train loss nanmean: 0.036195 2019-11-15 11:42:30.423: INFO @log_variables: train positive_distance nanmean: 0.555829 2019-11-15 11:42:30.423: INFO @log_variables: train negative_distance nanmean: 1.419392 2019-11-15 11:42:30.423: INFO @log_variables: valid loss nanmean: 0.272592 2019-11-15 11:42:30.423: INFO @log_variables: valid positive_distance nanmean: 0.676287 2019-11-15 11:42:30.423: INFO @log_variables: valid negative_distance nanmean: 1.400178 2019-11-15 11:42:30.424: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:44:46.727: INFO @metrics_hook: train matching accuracy: 0.9923231336805556, N=110592, DB_SIZE=110592, N_IDS=7304 2019-11-15 11:44:47.833: INFO @metrics_hook: valid matching accuracy: 0.9882691692438946, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:44:48.043: INFO @evaluate_embedding: best threshold 1.0382325947284698 2019-11-15 11:44:48.129: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:44:48.129: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:44:48.357: INFO @decay_lr : LR updated to `0.00023138721` 2019-11-15 11:44:48.729: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-15 11:44:48.753: INFO @log_profile : T train: 45.386714 2019-11-15 11:44:48.753: INFO @log_profile : T valid: 1.455173 2019-11-15 11:44:48.753: INFO @log_profile : T read data: 77.807218 2019-11-15 11:44:48.753: INFO @log_profile : T hooks: 147.223373 2019-11-15 11:44:48.753: INFO @main_loop : Epoch 292 done 2019-11-15 11:44:48.753: INFO @main_loop : Training epoch 293 2019-11-15 11:47:06.418: INFO @log_variables: train loss nanmean: 0.038600 2019-11-15 11:47:06.419: INFO @log_variables: train positive_distance nanmean: 0.556836 2019-11-15 11:47:06.419: INFO @log_variables: train negative_distance nanmean: 1.419369 2019-11-15 11:47:06.419: INFO @log_variables: valid loss nanmean: 0.272649 2019-11-15 11:47:06.419: INFO @log_variables: valid positive_distance nanmean: 0.672315 2019-11-15 11:47:06.419: INFO @log_variables: valid negative_distance nanmean: 1.400298 2019-11-15 11:47:06.419: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:49:24.141: INFO @metrics_hook: train matching accuracy: 0.9920970775462963, N=110592, DB_SIZE=110592, N_IDS=7301 2019-11-15 11:49:25.531: INFO @metrics_hook: valid matching accuracy: 0.9880558814119654, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:49:25.702: INFO @evaluate_embedding: best threshold 1.0363063216209412 2019-11-15 11:49:25.774: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:49:25.774: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:49:25.981: INFO @decay_lr : LR updated to `0.00023023027` 2019-11-15 11:49:25.982: INFO @log_profile : T train: 45.083676 2019-11-15 11:49:25.982: INFO @log_profile : T valid: 1.505412 2019-11-15 11:49:25.982: INFO @log_profile : T read data: 82.298263 2019-11-15 11:49:25.982: INFO @log_profile : T hooks: 148.272685 2019-11-15 11:49:25.982: INFO @main_loop : Epoch 293 done 2019-11-15 11:49:25.982: INFO @main_loop : Training epoch 294 2019-11-15 11:51:40.828: INFO @log_variables: train loss nanmean: 0.036779 2019-11-15 11:51:40.828: INFO @log_variables: train positive_distance nanmean: 0.556133 2019-11-15 11:51:40.829: INFO @log_variables: train negative_distance nanmean: 1.419398 2019-11-15 11:51:40.829: INFO @log_variables: valid loss nanmean: 0.273111 2019-11-15 11:51:40.829: INFO @log_variables: valid positive_distance nanmean: 0.673926 2019-11-15 11:51:40.829: INFO @log_variables: valid negative_distance nanmean: 1.399938 2019-11-15 11:51:40.829: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:53:57.820: INFO @metrics_hook: train matching accuracy: 0.9919160864454291, N=110590, DB_SIZE=110592, N_IDS=7316 2019-11-15 11:53:59.170: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:53:59.369: INFO @evaluate_embedding: best threshold 1.0369319021701813 2019-11-15 11:53:59.448: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:53:59.448: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:53:59.676: INFO @decay_lr : LR updated to `0.00022907912` 2019-11-15 11:53:59.678: INFO @log_profile : T train: 44.975647 2019-11-15 11:53:59.678: INFO @log_profile : T valid: 1.383518 2019-11-15 11:53:59.678: INFO @log_profile : T read data: 80.378108 2019-11-15 11:53:59.678: INFO @log_profile : T hooks: 146.874856 2019-11-15 11:53:59.678: INFO @main_loop : Epoch 294 done 2019-11-15 11:53:59.678: INFO @main_loop : Training epoch 295 2019-11-15 11:56:13.480: INFO @log_variables: train loss nanmean: 0.038003 2019-11-15 11:56:13.481: INFO @log_variables: train positive_distance nanmean: 0.557013 2019-11-15 11:56:13.481: INFO @log_variables: train negative_distance nanmean: 1.419378 2019-11-15 11:56:13.481: INFO @log_variables: valid loss nanmean: 0.275712 2019-11-15 11:56:13.481: INFO @log_variables: valid positive_distance nanmean: 0.674397 2019-11-15 11:56:13.481: INFO @log_variables: valid negative_distance nanmean: 1.399509 2019-11-15 11:56:13.481: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 11:58:31.589: INFO @metrics_hook: train matching accuracy: 0.9922688802083334, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 11:58:32.740: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 11:58:32.911: INFO @evaluate_embedding: best threshold 1.0369530022144315 2019-11-15 11:58:32.977: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 11:58:32.977: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 11:58:33.204: INFO @decay_lr : LR updated to `0.00022793372` 2019-11-15 11:58:33.206: INFO @log_profile : T train: 45.036610 2019-11-15 11:58:33.206: INFO @log_profile : T valid: 1.453644 2019-11-15 11:58:33.206: INFO @log_profile : T read data: 79.292353 2019-11-15 11:58:33.206: INFO @log_profile : T hooks: 147.675743 2019-11-15 11:58:33.206: INFO @main_loop : Epoch 295 done 2019-11-15 11:58:33.206: INFO @main_loop : Training epoch 296 2019-11-15 12:00:41.181: INFO @log_variables: train loss nanmean: 0.037684 2019-11-15 12:00:41.181: INFO @log_variables: train positive_distance nanmean: 0.557166 2019-11-15 12:00:41.181: INFO @log_variables: train negative_distance nanmean: 1.419381 2019-11-15 12:00:41.181: INFO @log_variables: valid loss nanmean: 0.275346 2019-11-15 12:00:41.181: INFO @log_variables: valid positive_distance nanmean: 0.676792 2019-11-15 12:00:41.182: INFO @log_variables: valid negative_distance nanmean: 1.399657 2019-11-15 12:00:41.182: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:02:51.232: INFO @metrics_hook: train matching accuracy: 0.9921693447025527, N=110591, DB_SIZE=110592, N_IDS=7310 2019-11-15 12:02:52.620: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:02:52.785: INFO @evaluate_embedding: best threshold 1.0382247865200043 2019-11-15 12:02:52.858: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:02:52.858: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:02:53.071: INFO @decay_lr : LR updated to `0.00022679406` 2019-11-15 12:02:53.073: INFO @log_profile : T train: 44.851155 2019-11-15 12:02:53.073: INFO @log_profile : T valid: 1.420058 2019-11-15 12:02:53.073: INFO @log_profile : T read data: 73.509202 2019-11-15 12:02:53.073: INFO @log_profile : T hooks: 140.015539 2019-11-15 12:02:53.073: INFO @main_loop : Epoch 296 done 2019-11-15 12:02:53.073: INFO @main_loop : Training epoch 297 2019-11-15 12:04:53.778: INFO @log_variables: train loss nanmean: 0.038257 2019-11-15 12:04:53.779: INFO @log_variables: train positive_distance nanmean: 0.556974 2019-11-15 12:04:53.779: INFO @log_variables: train negative_distance nanmean: 1.419391 2019-11-15 12:04:53.779: INFO @log_variables: valid loss nanmean: 0.275062 2019-11-15 12:04:53.779: INFO @log_variables: valid positive_distance nanmean: 0.675940 2019-11-15 12:04:53.779: INFO @log_variables: valid negative_distance nanmean: 1.400111 2019-11-15 12:04:53.779: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:07:16.261: INFO @metrics_hook: train matching accuracy: 0.9923321759259259, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 12:07:17.881: INFO @metrics_hook: valid matching accuracy: 0.9880558814119654, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:07:18.087: INFO @evaluate_embedding: best threshold 1.0380253493785858 2019-11-15 12:07:18.183: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:07:18.183: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:07:18.467: INFO @decay_lr : LR updated to `0.00022566009` 2019-11-15 12:07:18.469: INFO @log_profile : T train: 44.767197 2019-11-15 12:07:18.469: INFO @log_profile : T valid: 1.452970 2019-11-15 12:07:18.469: INFO @log_profile : T read data: 65.652177 2019-11-15 12:07:18.469: INFO @log_profile : T hooks: 153.431442 2019-11-15 12:07:18.469: INFO @main_loop : Epoch 297 done 2019-11-15 12:07:18.469: INFO @main_loop : Training epoch 298 2019-11-15 12:10:02.576: INFO @log_variables: train loss nanmean: 0.037605 2019-11-15 12:10:02.576: INFO @log_variables: train positive_distance nanmean: 0.555699 2019-11-15 12:10:02.576: INFO @log_variables: train negative_distance nanmean: 1.419380 2019-11-15 12:10:02.576: INFO @log_variables: valid loss nanmean: 0.274611 2019-11-15 12:10:02.577: INFO @log_variables: valid positive_distance nanmean: 0.673988 2019-11-15 12:10:02.577: INFO @log_variables: valid negative_distance nanmean: 1.399473 2019-11-15 12:10:02.577: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:12:31.568: INFO @metrics_hook: train matching accuracy: 0.9927481192129629, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 12:12:33.000: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:12:33.235: INFO @evaluate_embedding: best threshold 1.036730647087097 2019-11-15 12:12:33.343: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:12:33.343: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:12:33.587: INFO @decay_lr : LR updated to `0.00022453179` 2019-11-15 12:12:33.588: INFO @log_profile : T train: 46.164907 2019-11-15 12:12:33.588: INFO @log_profile : T valid: 1.602349 2019-11-15 12:12:33.588: INFO @log_profile : T read data: 104.043814 2019-11-15 12:12:33.589: INFO @log_profile : T hooks: 163.212459 2019-11-15 12:12:33.589: INFO @main_loop : Epoch 298 done 2019-11-15 12:12:33.589: INFO @main_loop : Training epoch 299 2019-11-15 12:15:06.821: INFO @log_variables: train loss nanmean: 0.038071 2019-11-15 12:15:06.822: INFO @log_variables: train positive_distance nanmean: 0.557534 2019-11-15 12:15:06.822: INFO @log_variables: train negative_distance nanmean: 1.419385 2019-11-15 12:15:06.822: INFO @log_variables: valid loss nanmean: 0.278692 2019-11-15 12:15:06.822: INFO @log_variables: valid positive_distance nanmean: 0.675024 2019-11-15 12:15:06.822: INFO @log_variables: valid negative_distance nanmean: 1.399509 2019-11-15 12:15:06.822: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:17:36.056: INFO @metrics_hook: train matching accuracy: 0.9926123519305543, N=110590, DB_SIZE=110592, N_IDS=7309 2019-11-15 12:17:37.842: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:17:38.135: INFO @evaluate_embedding: best threshold 1.03726652264595 2019-11-15 12:17:38.287: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:17:38.287: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:17:38.840: INFO @decay_lr : LR updated to `0.00022340912` 2019-11-15 12:17:38.843: INFO @log_profile : T train: 46.482527 2019-11-15 12:17:38.844: INFO @log_profile : T valid: 1.588823 2019-11-15 12:17:38.844: INFO @log_profile : T read data: 94.795512 2019-11-15 12:17:38.844: INFO @log_profile : T hooks: 162.302565 2019-11-15 12:17:38.844: INFO @main_loop : Epoch 299 done 2019-11-15 12:17:38.844: INFO @main_loop : Training epoch 300 2019-11-15 12:20:14.966: INFO @log_variables: train loss nanmean: 0.038351 2019-11-15 12:20:14.967: INFO @log_variables: train positive_distance nanmean: 0.557214 2019-11-15 12:20:14.967: INFO @log_variables: train negative_distance nanmean: 1.419399 2019-11-15 12:20:14.967: INFO @log_variables: valid loss nanmean: 0.275783 2019-11-15 12:20:14.967: INFO @log_variables: valid positive_distance nanmean: 0.677642 2019-11-15 12:20:14.967: INFO @log_variables: valid negative_distance nanmean: 1.399702 2019-11-15 12:20:14.968: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:22:37.181: INFO @metrics_hook: train matching accuracy: 0.99325442395855, N=110591, DB_SIZE=110592, N_IDS=7314 2019-11-15 12:22:38.772: INFO @metrics_hook: valid matching accuracy: 0.9880558814119654, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:22:39.234: INFO @evaluate_embedding: best threshold 1.0386717915534973 2019-11-15 12:22:39.450: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:22:39.450: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:22:39.916: INFO @decay_lr : LR updated to `0.00022229207` 2019-11-15 12:22:39.919: INFO @log_profile : T train: 46.548107 2019-11-15 12:22:39.919: INFO @log_profile : T valid: 1.567033 2019-11-15 12:22:39.919: INFO @log_profile : T read data: 96.117644 2019-11-15 12:22:39.919: INFO @log_profile : T hooks: 156.768941 2019-11-15 12:22:39.919: INFO @main_loop : Epoch 300 done 2019-11-15 12:22:39.919: INFO @main_loop : Training epoch 301 2019-11-15 12:25:39.034: INFO @log_variables: train loss nanmean: 0.037188 2019-11-15 12:25:39.034: INFO @log_variables: train positive_distance nanmean: 0.557252 2019-11-15 12:25:39.035: INFO @log_variables: train negative_distance nanmean: 1.419380 2019-11-15 12:25:39.035: INFO @log_variables: valid loss nanmean: 0.276707 2019-11-15 12:25:39.035: INFO @log_variables: valid positive_distance nanmean: 0.675054 2019-11-15 12:25:39.035: INFO @log_variables: valid negative_distance nanmean: 1.399863 2019-11-15 12:25:39.035: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:28:13.169: INFO @metrics_hook: train matching accuracy: 0.9923049796095523, N=110591, DB_SIZE=110592, N_IDS=7321 2019-11-15 12:28:14.598: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:28:14.818: INFO @evaluate_embedding: best threshold 1.0374583601951601 2019-11-15 12:28:14.913: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:28:14.913: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:28:15.148: INFO @decay_lr : LR updated to `0.00022118061` 2019-11-15 12:28:15.149: INFO @log_profile : T train: 52.382346 2019-11-15 12:28:15.150: INFO @log_profile : T valid: 1.676059 2019-11-15 12:28:15.150: INFO @log_profile : T read data: 116.382271 2019-11-15 12:28:15.150: INFO @log_profile : T hooks: 164.718207 2019-11-15 12:28:15.150: INFO @main_loop : Epoch 301 done 2019-11-15 12:28:15.150: INFO @main_loop : Training epoch 302 2019-11-15 12:31:15.666: INFO @log_variables: train loss nanmean: 0.037345 2019-11-15 12:31:15.666: INFO @log_variables: train positive_distance nanmean: 0.557140 2019-11-15 12:31:15.667: INFO @log_variables: train negative_distance nanmean: 1.419398 2019-11-15 12:31:15.667: INFO @log_variables: valid loss nanmean: 0.273873 2019-11-15 12:31:15.667: INFO @log_variables: valid positive_distance nanmean: 0.676302 2019-11-15 12:31:15.667: INFO @log_variables: valid negative_distance nanmean: 1.400080 2019-11-15 12:31:15.667: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:33:50.137: INFO @metrics_hook: train matching accuracy: 0.992558164769285, N=110591, DB_SIZE=110592, N_IDS=7296 2019-11-15 12:33:51.560: INFO @metrics_hook: valid matching accuracy: 0.9882691692438946, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:33:51.808: INFO @evaluate_embedding: best threshold 1.0381911993026733 2019-11-15 12:33:51.907: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:33:51.907: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:33:52.192: INFO @decay_lr : LR updated to `0.00022007471` 2019-11-15 12:33:52.194: INFO @log_profile : T train: 46.778004 2019-11-15 12:33:52.194: INFO @log_profile : T valid: 1.482391 2019-11-15 12:33:52.194: INFO @log_profile : T read data: 124.145773 2019-11-15 12:33:52.194: INFO @log_profile : T hooks: 164.563962 2019-11-15 12:33:52.194: INFO @main_loop : Epoch 302 done 2019-11-15 12:33:52.194: INFO @main_loop : Training epoch 303 2019-11-15 12:36:48.368: INFO @log_variables: train loss nanmean: 0.038310 2019-11-15 12:36:48.368: INFO @log_variables: train positive_distance nanmean: 0.557129 2019-11-15 12:36:48.368: INFO @log_variables: train negative_distance nanmean: 1.419406 2019-11-15 12:36:48.368: INFO @log_variables: valid loss nanmean: 0.273953 2019-11-15 12:36:48.368: INFO @log_variables: valid positive_distance nanmean: 0.674346 2019-11-15 12:36:48.368: INFO @log_variables: valid negative_distance nanmean: 1.399875 2019-11-15 12:36:48.368: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:39:16.240: INFO @metrics_hook: train matching accuracy: 0.9929651331018519, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-15 12:39:17.677: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:39:17.879: INFO @evaluate_embedding: best threshold 1.0371103882789612 2019-11-15 12:39:17.962: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:39:17.962: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:39:18.194: INFO @decay_lr : LR updated to `0.00021897434` 2019-11-15 12:39:18.195: INFO @log_profile : T train: 47.377593 2019-11-15 12:39:18.196: INFO @log_profile : T valid: 1.513826 2019-11-15 12:39:18.196: INFO @log_profile : T read data: 116.804190 2019-11-15 12:39:18.196: INFO @log_profile : T hooks: 160.227545 2019-11-15 12:39:18.196: INFO @main_loop : Epoch 303 done 2019-11-15 12:39:18.196: INFO @main_loop : Training epoch 304 2019-11-15 12:42:02.252: INFO @log_variables: train loss nanmean: 0.037535 2019-11-15 12:42:02.253: INFO @log_variables: train positive_distance nanmean: 0.556860 2019-11-15 12:42:02.253: INFO @log_variables: train negative_distance nanmean: 1.419355 2019-11-15 12:42:02.253: INFO @log_variables: valid loss nanmean: 0.272934 2019-11-15 12:42:02.253: INFO @log_variables: valid positive_distance nanmean: 0.675534 2019-11-15 12:42:02.254: INFO @log_variables: valid negative_distance nanmean: 1.400248 2019-11-15 12:42:02.254: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:44:30.521: INFO @metrics_hook: train matching accuracy: 0.9924768518518519, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 12:44:32.326: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:44:32.691: INFO @evaluate_embedding: best threshold 1.037891149520874 2019-11-15 12:44:32.980: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:44:32.980: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:44:33.541: INFO @decay_lr : LR updated to `0.00021787947` 2019-11-15 12:44:33.573: INFO @log_profile : T train: 46.783066 2019-11-15 12:44:33.577: INFO @log_profile : T valid: 1.449033 2019-11-15 12:44:33.577: INFO @log_profile : T read data: 106.500727 2019-11-15 12:44:33.577: INFO @log_profile : T hooks: 160.571078 2019-11-15 12:44:33.578: INFO @main_loop : Epoch 304 done 2019-11-15 12:44:33.579: INFO @main_loop : Training epoch 305 2019-11-15 12:47:10.410: INFO @log_variables: train loss nanmean: 0.037693 2019-11-15 12:47:10.410: INFO @log_variables: train positive_distance nanmean: 0.556379 2019-11-15 12:47:10.410: INFO @log_variables: train negative_distance nanmean: 1.419382 2019-11-15 12:47:10.411: INFO @log_variables: valid loss nanmean: 0.277322 2019-11-15 12:47:10.411: INFO @log_variables: valid positive_distance nanmean: 0.674247 2019-11-15 12:47:10.411: INFO @log_variables: valid negative_distance nanmean: 1.399849 2019-11-15 12:47:10.413: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:49:44.767: INFO @metrics_hook: train matching accuracy: 0.9924857582059861, N=110590, DB_SIZE=110592, N_IDS=7318 2019-11-15 12:49:46.186: INFO @metrics_hook: valid matching accuracy: 0.9885891009917884, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:49:46.640: INFO @evaluate_embedding: best threshold 1.0370480418205263 2019-11-15 12:49:46.754: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:49:46.754: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:49:47.100: INFO @decay_lr : LR updated to `0.00021679007` 2019-11-15 12:49:47.694: INFO @save : Model saved to: ./log/EmbeddingMiniMiniModel_loving-rosalind/model_best_matching.ckpt 2019-11-15 12:49:47.739: INFO @log_profile : T train: 46.511858 2019-11-15 12:49:47.743: INFO @log_profile : T valid: 1.503498 2019-11-15 12:49:47.743: INFO @log_profile : T read data: 98.775635 2019-11-15 12:49:47.743: INFO @log_profile : T hooks: 167.286509 2019-11-15 12:49:47.743: INFO @main_loop : Epoch 305 done 2019-11-15 12:49:47.743: INFO @main_loop : Training epoch 306 2019-11-15 12:52:20.384: INFO @log_variables: train loss nanmean: 0.037389 2019-11-15 12:52:20.385: INFO @log_variables: train positive_distance nanmean: 0.556680 2019-11-15 12:52:20.385: INFO @log_variables: train negative_distance nanmean: 1.419385 2019-11-15 12:52:20.385: INFO @log_variables: valid loss nanmean: 0.278413 2019-11-15 12:52:20.385: INFO @log_variables: valid positive_distance nanmean: 0.673306 2019-11-15 12:52:20.386: INFO @log_variables: valid negative_distance nanmean: 1.399601 2019-11-15 12:52:20.386: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:54:49.350: INFO @metrics_hook: train matching accuracy: 0.9916720920138888, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 12:54:50.467: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:54:50.733: INFO @evaluate_embedding: best threshold 1.036453306674957 2019-11-15 12:54:50.859: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:54:50.859: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:54:51.260: INFO @decay_lr : LR updated to `0.00021570612` 2019-11-15 12:54:51.262: INFO @log_profile : T train: 46.615085 2019-11-15 12:54:51.262: INFO @log_profile : T valid: 1.591248 2019-11-15 12:54:51.262: INFO @log_profile : T read data: 93.225073 2019-11-15 12:54:51.262: INFO @log_profile : T hooks: 161.996375 2019-11-15 12:54:51.262: INFO @main_loop : Epoch 306 done 2019-11-15 12:54:51.262: INFO @main_loop : Training epoch 307 2019-11-15 12:57:18.988: INFO @log_variables: train loss nanmean: 0.037439 2019-11-15 12:57:18.988: INFO @log_variables: train positive_distance nanmean: 0.555222 2019-11-15 12:57:18.988: INFO @log_variables: train negative_distance nanmean: 1.419382 2019-11-15 12:57:18.988: INFO @log_variables: valid loss nanmean: 0.275281 2019-11-15 12:57:18.988: INFO @log_variables: valid positive_distance nanmean: 0.674913 2019-11-15 12:57:18.988: INFO @log_variables: valid negative_distance nanmean: 1.399781 2019-11-15 12:57:18.988: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 12:59:43.429: INFO @metrics_hook: train matching accuracy: 0.9923863605537521, N=110591, DB_SIZE=110592, N_IDS=7315 2019-11-15 12:59:44.707: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 12:59:44.901: INFO @evaluate_embedding: best threshold 1.0373470187187197 2019-11-15 12:59:44.992: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 12:59:44.992: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 12:59:45.283: INFO @decay_lr : LR updated to `0.0002146276` 2019-11-15 12:59:45.285: INFO @log_profile : T train: 46.574698 2019-11-15 12:59:45.285: INFO @log_profile : T valid: 1.549051 2019-11-15 12:59:45.285: INFO @log_profile : T read data: 88.991185 2019-11-15 12:59:45.286: INFO @log_profile : T hooks: 156.832636 2019-11-15 12:59:45.286: INFO @main_loop : Epoch 307 done 2019-11-15 12:59:45.286: INFO @main_loop : Training epoch 308 2019-11-15 13:02:16.044: INFO @log_variables: train loss nanmean: 0.036776 2019-11-15 13:02:16.045: INFO @log_variables: train positive_distance nanmean: 0.556102 2019-11-15 13:02:16.045: INFO @log_variables: train negative_distance nanmean: 1.419412 2019-11-15 13:02:16.045: INFO @log_variables: valid loss nanmean: 0.273526 2019-11-15 13:02:16.045: INFO @log_variables: valid positive_distance nanmean: 0.675243 2019-11-15 13:02:16.045: INFO @log_variables: valid negative_distance nanmean: 1.399446 2019-11-15 13:02:16.045: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:04:49.520: INFO @metrics_hook: train matching accuracy: 0.9929560908564815, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 13:04:51.101: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:04:51.618: INFO @evaluate_embedding: best threshold 1.0373444557189944 2019-11-15 13:04:51.723: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:04:51.723: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:04:52.200: INFO @decay_lr : LR updated to `0.00021355446` 2019-11-15 13:04:52.202: INFO @log_profile : T train: 46.591629 2019-11-15 13:04:52.202: INFO @log_profile : T valid: 1.497958 2019-11-15 13:04:52.202: INFO @log_profile : T read data: 95.010798 2019-11-15 13:04:52.202: INFO @log_profile : T hooks: 163.742882 2019-11-15 13:04:52.202: INFO @main_loop : Epoch 308 done 2019-11-15 13:04:52.202: INFO @main_loop : Training epoch 309 2019-11-15 13:07:39.101: INFO @log_variables: train loss nanmean: 0.036936 2019-11-15 13:07:39.102: INFO @log_variables: train positive_distance nanmean: 0.556463 2019-11-15 13:07:39.102: INFO @log_variables: train negative_distance nanmean: 1.419383 2019-11-15 13:07:39.102: INFO @log_variables: valid loss nanmean: 0.274556 2019-11-15 13:07:39.102: INFO @log_variables: valid positive_distance nanmean: 0.676629 2019-11-15 13:07:39.102: INFO @log_variables: valid negative_distance nanmean: 1.400095 2019-11-15 13:07:39.102: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:10:02.770: INFO @metrics_hook: train matching accuracy: 0.9915363818032209, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-15 13:10:04.159: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:10:04.697: INFO @evaluate_embedding: best threshold 1.038362056016922 2019-11-15 13:10:04.892: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:10:04.893: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:10:05.343: INFO @decay_lr : LR updated to `0.00021248669` 2019-11-15 13:10:05.345: INFO @log_profile : T train: 46.944396 2019-11-15 13:10:05.345: INFO @log_profile : T valid: 1.410747 2019-11-15 13:10:05.345: INFO @log_profile : T read data: 111.054150 2019-11-15 13:10:05.346: INFO @log_profile : T hooks: 153.658432 2019-11-15 13:10:05.346: INFO @main_loop : Epoch 309 done 2019-11-15 13:10:05.346: INFO @main_loop : Training epoch 310 2019-11-15 13:12:59.257: INFO @log_variables: train loss nanmean: 0.037474 2019-11-15 13:12:59.257: INFO @log_variables: train positive_distance nanmean: 0.555243 2019-11-15 13:12:59.257: INFO @log_variables: train negative_distance nanmean: 1.419398 2019-11-15 13:12:59.257: INFO @log_variables: valid loss nanmean: 0.274696 2019-11-15 13:12:59.257: INFO @log_variables: valid positive_distance nanmean: 0.678156 2019-11-15 13:12:59.257: INFO @log_variables: valid negative_distance nanmean: 1.400066 2019-11-15 13:12:59.257: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:15:28.692: INFO @metrics_hook: train matching accuracy: 0.9930465133101852, N=110592, DB_SIZE=110592, N_IDS=7317 2019-11-15 13:15:29.646: INFO @metrics_hook: valid matching accuracy: 0.9878425935800362, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:15:29.858: INFO @evaluate_embedding: best threshold 1.0391106009483337 2019-11-15 13:15:29.996: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:15:29.996: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:15:30.348: INFO @decay_lr : LR updated to `0.00021142425` 2019-11-15 13:15:30.350: INFO @log_profile : T train: 46.730864 2019-11-15 13:15:30.350: INFO @log_profile : T valid: 1.573590 2019-11-15 13:15:30.350: INFO @log_profile : T read data: 117.657704 2019-11-15 13:15:30.350: INFO @log_profile : T hooks: 158.967453 2019-11-15 13:15:30.350: INFO @main_loop : Epoch 310 done 2019-11-15 13:15:30.350: INFO @main_loop : Training epoch 311 2019-11-15 13:18:39.201: INFO @log_variables: train loss nanmean: 0.037369 2019-11-15 13:18:39.202: INFO @log_variables: train positive_distance nanmean: 0.555866 2019-11-15 13:18:39.202: INFO @log_variables: train negative_distance nanmean: 1.419388 2019-11-15 13:18:39.202: INFO @log_variables: valid loss nanmean: 0.273316 2019-11-15 13:18:39.202: INFO @log_variables: valid positive_distance nanmean: 0.677342 2019-11-15 13:18:39.202: INFO @log_variables: valid negative_distance nanmean: 1.400383 2019-11-15 13:18:39.202: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:21:03.212: INFO @metrics_hook: train matching accuracy: 0.9924678096064815, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-15 13:21:04.531: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:21:04.989: INFO @evaluate_embedding: best threshold 1.0388624966144564 2019-11-15 13:21:05.157: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:21:05.157: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:21:05.600: INFO @decay_lr : LR updated to `0.00021036713` 2019-11-15 13:21:05.602: INFO @log_profile : T train: 49.192888 2019-11-15 13:21:05.602: INFO @log_profile : T valid: 1.614090 2019-11-15 13:21:05.603: INFO @log_profile : T read data: 130.163699 2019-11-15 13:21:05.603: INFO @log_profile : T hooks: 154.201288 2019-11-15 13:21:05.603: INFO @main_loop : Epoch 311 done 2019-11-15 13:21:05.603: INFO @main_loop : Training epoch 312 2019-11-15 13:24:15.275: INFO @log_variables: train loss nanmean: 0.037488 2019-11-15 13:24:15.276: INFO @log_variables: train positive_distance nanmean: 0.557481 2019-11-15 13:24:15.276: INFO @log_variables: train negative_distance nanmean: 1.419377 2019-11-15 13:24:15.276: INFO @log_variables: valid loss nanmean: 0.273175 2019-11-15 13:24:15.276: INFO @log_variables: valid positive_distance nanmean: 0.675808 2019-11-15 13:24:15.277: INFO @log_variables: valid negative_distance nanmean: 1.400151 2019-11-15 13:24:15.277: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:26:46.165: INFO @metrics_hook: train matching accuracy: 0.9924406828703703, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 13:26:47.599: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:26:47.996: INFO @evaluate_embedding: best threshold 1.0379793941974638 2019-11-15 13:26:48.172: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:26:48.172: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:26:48.565: INFO @decay_lr : LR updated to `0.00020931529` 2019-11-15 13:26:48.569: INFO @log_profile : T train: 58.365020 2019-11-15 13:26:48.569: INFO @log_profile : T valid: 1.626809 2019-11-15 13:26:48.569: INFO @log_profile : T read data: 121.323925 2019-11-15 13:26:48.569: INFO @log_profile : T hooks: 161.566403 2019-11-15 13:26:48.569: INFO @main_loop : Epoch 312 done 2019-11-15 13:26:48.569: INFO @main_loop : Training epoch 313 2019-11-15 13:29:51.571: INFO @log_variables: train loss nanmean: 0.037206 2019-11-15 13:29:51.572: INFO @log_variables: train positive_distance nanmean: 0.556946 2019-11-15 13:29:51.572: INFO @log_variables: train negative_distance nanmean: 1.419382 2019-11-15 13:29:51.572: INFO @log_variables: valid loss nanmean: 0.271612 2019-11-15 13:29:51.572: INFO @log_variables: valid positive_distance nanmean: 0.677100 2019-11-15 13:29:51.572: INFO @log_variables: valid negative_distance nanmean: 1.400316 2019-11-15 13:29:51.572: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:32:29.307: INFO @metrics_hook: train matching accuracy: 0.9922235986653525, N=110591, DB_SIZE=110592, N_IDS=7305 2019-11-15 13:32:30.835: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:32:31.256: INFO @evaluate_embedding: best threshold 1.0387080609798434 2019-11-15 13:32:31.387: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:32:31.387: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:32:31.705: INFO @decay_lr : LR updated to `0.00020826871` 2019-11-15 13:32:31.707: INFO @log_profile : T train: 58.176450 2019-11-15 13:32:31.707: INFO @log_profile : T valid: 1.538059 2019-11-15 13:32:31.707: INFO @log_profile : T read data: 113.227412 2019-11-15 13:32:31.707: INFO @log_profile : T hooks: 170.107358 2019-11-15 13:32:31.707: INFO @main_loop : Epoch 313 done 2019-11-15 13:32:31.708: INFO @main_loop : Training epoch 314 2019-11-15 13:34:39.878: INFO @log_variables: train loss nanmean: 0.036078 2019-11-15 13:34:39.878: INFO @log_variables: train positive_distance nanmean: 0.554880 2019-11-15 13:34:39.879: INFO @log_variables: train negative_distance nanmean: 1.419385 2019-11-15 13:34:39.879: INFO @log_variables: valid loss nanmean: 0.270319 2019-11-15 13:34:39.879: INFO @log_variables: valid positive_distance nanmean: 0.676754 2019-11-15 13:34:39.879: INFO @log_variables: valid negative_distance nanmean: 1.400577 2019-11-15 13:34:39.879: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:37:08.388: INFO @metrics_hook: train matching accuracy: 0.9926396122685185, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 13:37:10.097: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:37:10.326: INFO @evaluate_embedding: best threshold 1.038665682077408 2019-11-15 13:37:10.450: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:37:10.450: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:37:10.732: INFO @decay_lr : LR updated to `0.00020722736` 2019-11-15 13:37:10.733: INFO @log_profile : T train: 54.416229 2019-11-15 13:37:10.733: INFO @log_profile : T valid: 1.537464 2019-11-15 13:37:10.734: INFO @log_profile : T read data: 66.052272 2019-11-15 13:37:10.734: INFO @log_profile : T hooks: 156.944421 2019-11-15 13:37:10.734: INFO @main_loop : Epoch 314 done 2019-11-15 13:37:10.734: INFO @main_loop : Training epoch 315 2019-11-15 13:40:15.734: INFO @log_variables: train loss nanmean: 0.036259 2019-11-15 13:40:15.735: INFO @log_variables: train positive_distance nanmean: 0.555327 2019-11-15 13:40:15.736: INFO @log_variables: train negative_distance nanmean: 1.419411 2019-11-15 13:40:15.736: INFO @log_variables: valid loss nanmean: 0.273741 2019-11-15 13:40:15.736: INFO @log_variables: valid positive_distance nanmean: 0.676730 2019-11-15 13:40:15.737: INFO @log_variables: valid negative_distance nanmean: 1.400064 2019-11-15 13:40:15.737: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:42:53.183: INFO @metrics_hook: train matching accuracy: 0.9927300347222222, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 13:42:54.625: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:42:55.125: INFO @evaluate_embedding: best threshold 1.0383971035480501 2019-11-15 13:42:55.343: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:42:55.343: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:42:55.804: INFO @decay_lr : LR updated to `0.00020619122` 2019-11-15 13:42:55.806: INFO @log_profile : T train: 53.333715 2019-11-15 13:42:55.806: INFO @log_profile : T valid: 1.498186 2019-11-15 13:42:55.806: INFO @log_profile : T read data: 120.046302 2019-11-15 13:42:55.806: INFO @log_profile : T hooks: 170.120816 2019-11-15 13:42:55.806: INFO @main_loop : Epoch 315 done 2019-11-15 13:42:55.806: INFO @main_loop : Training epoch 316 2019-11-15 13:45:41.216: INFO @log_variables: train loss nanmean: 0.036844 2019-11-15 13:45:41.216: INFO @log_variables: train positive_distance nanmean: 0.556665 2019-11-15 13:45:41.216: INFO @log_variables: train negative_distance nanmean: 1.419385 2019-11-15 13:45:41.216: INFO @log_variables: valid loss nanmean: 0.275483 2019-11-15 13:45:41.217: INFO @log_variables: valid positive_distance nanmean: 0.678252 2019-11-15 13:45:41.217: INFO @log_variables: valid negative_distance nanmean: 1.400576 2019-11-15 13:45:41.217: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:48:04.561: INFO @metrics_hook: train matching accuracy: 0.992431640625, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-15 13:48:05.782: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:48:06.034: INFO @evaluate_embedding: best threshold 1.0394136905670166 2019-11-15 13:48:06.187: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:48:06.187: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:48:06.472: INFO @decay_lr : LR updated to `0.00020516026` 2019-11-15 13:48:06.474: INFO @log_profile : T train: 54.769263 2019-11-15 13:48:06.474: INFO @log_profile : T valid: 1.381137 2019-11-15 13:48:06.474: INFO @log_profile : T read data: 103.123229 2019-11-15 13:48:06.474: INFO @log_profile : T hooks: 151.319453 2019-11-15 13:48:06.474: INFO @main_loop : Epoch 316 done 2019-11-15 13:48:06.474: INFO @main_loop : Training epoch 317 2019-11-15 13:50:12.910: INFO @log_variables: train loss nanmean: 0.036620 2019-11-15 13:50:12.910: INFO @log_variables: train positive_distance nanmean: 0.554923 2019-11-15 13:50:12.910: INFO @log_variables: train negative_distance nanmean: 1.419396 2019-11-15 13:50:12.910: INFO @log_variables: valid loss nanmean: 0.276866 2019-11-15 13:50:12.910: INFO @log_variables: valid positive_distance nanmean: 0.677203 2019-11-15 13:50:12.910: INFO @log_variables: valid negative_distance nanmean: 1.399895 2019-11-15 13:50:12.910: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:52:25.841: INFO @metrics_hook: train matching accuracy: 0.9929921964716839, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-15 13:52:27.094: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:52:27.346: INFO @evaluate_embedding: best threshold 1.0385491847991946 2019-11-15 13:52:27.480: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:52:27.480: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:52:27.765: INFO @decay_lr : LR updated to `0.00020413446` 2019-11-15 13:52:27.766: INFO @log_profile : T train: 50.566327 2019-11-15 13:52:27.766: INFO @log_profile : T valid: 1.521232 2019-11-15 13:52:27.766: INFO @log_profile : T read data: 68.347912 2019-11-15 13:52:27.766: INFO @log_profile : T hooks: 140.784276 2019-11-15 13:52:27.766: INFO @main_loop : Epoch 317 done 2019-11-15 13:52:27.767: INFO @main_loop : Training epoch 318 2019-11-15 13:54:36.192: INFO @log_variables: train loss nanmean: 0.037672 2019-11-15 13:54:36.192: INFO @log_variables: train positive_distance nanmean: 0.556367 2019-11-15 13:54:36.192: INFO @log_variables: train negative_distance nanmean: 1.419401 2019-11-15 13:54:36.192: INFO @log_variables: valid loss nanmean: 0.275754 2019-11-15 13:54:36.192: INFO @log_variables: valid positive_distance nanmean: 0.675533 2019-11-15 13:54:36.192: INFO @log_variables: valid negative_distance nanmean: 1.400238 2019-11-15 13:54:36.192: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 13:56:42.032: INFO @metrics_hook: train matching accuracy: 0.9919524016203703, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-15 13:56:43.098: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 13:56:43.333: INFO @evaluate_embedding: best threshold 1.037885516881943 2019-11-15 13:56:43.429: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 13:56:43.429: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 13:56:43.722: INFO @decay_lr : LR updated to `0.00020311378` 2019-11-15 13:56:43.724: INFO @log_profile : T train: 49.604986 2019-11-15 13:56:43.725: INFO @log_profile : T valid: 1.376836 2019-11-15 13:56:43.726: INFO @log_profile : T read data: 71.113640 2019-11-15 13:56:43.726: INFO @log_profile : T hooks: 133.788885 2019-11-15 13:56:43.726: INFO @main_loop : Epoch 318 done 2019-11-15 13:56:43.726: INFO @main_loop : Training epoch 319 2019-11-15 13:58:54.928: INFO @log_variables: train loss nanmean: 0.037317 2019-11-15 13:58:54.929: INFO @log_variables: train positive_distance nanmean: 0.556986 2019-11-15 13:58:54.929: INFO @log_variables: train negative_distance nanmean: 1.419371 2019-11-15 13:58:54.929: INFO @log_variables: valid loss nanmean: 0.273410 2019-11-15 13:58:54.929: INFO @log_variables: valid positive_distance nanmean: 0.673773 2019-11-15 13:58:54.929: INFO @log_variables: valid negative_distance nanmean: 1.399874 2019-11-15 13:58:54.929: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:01:04.352: INFO @metrics_hook: train matching accuracy: 0.9927662037037037, N=110592, DB_SIZE=110592, N_IDS=7302 2019-11-15 14:01:05.706: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:01:05.903: INFO @evaluate_embedding: best threshold 1.036823362112045 2019-11-15 14:01:06.001: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:01:06.001: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:01:06.278: INFO @decay_lr : LR updated to `0.00020209822` 2019-11-15 14:01:06.280: INFO @log_profile : T train: 47.346968 2019-11-15 14:01:06.280: INFO @log_profile : T valid: 1.379908 2019-11-15 14:01:06.280: INFO @log_profile : T read data: 76.422609 2019-11-15 14:01:06.280: INFO @log_profile : T hooks: 137.327119 2019-11-15 14:01:06.280: INFO @main_loop : Epoch 319 done 2019-11-15 14:01:06.280: INFO @main_loop : Training epoch 320 2019-11-15 14:03:25.917: INFO @log_variables: train loss nanmean: 0.036313 2019-11-15 14:03:25.918: INFO @log_variables: train positive_distance nanmean: 0.556238 2019-11-15 14:03:25.918: INFO @log_variables: train negative_distance nanmean: 1.419391 2019-11-15 14:03:25.918: INFO @log_variables: valid loss nanmean: 0.275624 2019-11-15 14:03:25.918: INFO @log_variables: valid positive_distance nanmean: 0.676055 2019-11-15 14:03:25.918: INFO @log_variables: valid negative_distance nanmean: 1.400207 2019-11-15 14:03:25.918: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:05:35.904: INFO @metrics_hook: train matching accuracy: 0.9929107514241794, N=110590, DB_SIZE=110592, N_IDS=7310 2019-11-15 14:05:37.446: INFO @metrics_hook: valid matching accuracy: 0.9879492374960008, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:05:37.669: INFO @evaluate_embedding: best threshold 1.0381310284137726 2019-11-15 14:05:37.755: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:05:37.755: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:05:38.099: INFO @decay_lr : LR updated to `0.00020108774` 2019-11-15 14:05:38.100: INFO @log_profile : T train: 52.595759 2019-11-15 14:05:38.101: INFO @log_profile : T valid: 1.379889 2019-11-15 14:05:38.101: INFO @log_profile : T read data: 79.773567 2019-11-15 14:05:38.101: INFO @log_profile : T hooks: 137.994860 2019-11-15 14:05:38.101: INFO @main_loop : Epoch 320 done 2019-11-15 14:05:38.101: INFO @main_loop : Training epoch 321 2019-11-15 14:07:55.481: INFO @log_variables: train loss nanmean: 0.036213 2019-11-15 14:07:55.481: INFO @log_variables: train positive_distance nanmean: 0.555724 2019-11-15 14:07:55.481: INFO @log_variables: train negative_distance nanmean: 1.419419 2019-11-15 14:07:55.481: INFO @log_variables: valid loss nanmean: 0.278482 2019-11-15 14:07:55.481: INFO @log_variables: valid positive_distance nanmean: 0.675040 2019-11-15 14:07:55.481: INFO @log_variables: valid negative_distance nanmean: 1.400266 2019-11-15 14:07:55.481: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:10:11.666: INFO @metrics_hook: train matching accuracy: 0.9931459780092593, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 14:10:13.051: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:10:13.284: INFO @evaluate_embedding: best threshold 1.0376529097557068 2019-11-15 14:10:13.460: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:10:13.460: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:10:13.717: INFO @decay_lr : LR updated to `0.0002000823` 2019-11-15 14:10:13.719: INFO @log_profile : T train: 46.927495 2019-11-15 14:10:13.719: INFO @log_profile : T valid: 1.374268 2019-11-15 14:10:13.719: INFO @log_profile : T read data: 83.055908 2019-11-15 14:10:13.720: INFO @log_profile : T hooks: 144.192098 2019-11-15 14:10:13.720: INFO @main_loop : Epoch 321 done 2019-11-15 14:10:13.720: INFO @main_loop : Training epoch 322 2019-11-15 14:12:35.135: INFO @log_variables: train loss nanmean: 0.036855 2019-11-15 14:12:35.136: INFO @log_variables: train positive_distance nanmean: 0.555474 2019-11-15 14:12:35.136: INFO @log_variables: train negative_distance nanmean: 1.419406 2019-11-15 14:12:35.136: INFO @log_variables: valid loss nanmean: 0.275268 2019-11-15 14:12:35.136: INFO @log_variables: valid positive_distance nanmean: 0.674733 2019-11-15 14:12:35.136: INFO @log_variables: valid negative_distance nanmean: 1.400031 2019-11-15 14:12:35.136: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:14:46.883: INFO @metrics_hook: train matching accuracy: 0.9934804231847364, N=110590, DB_SIZE=110592, N_IDS=7316 2019-11-15 14:14:48.254: INFO @metrics_hook: valid matching accuracy: 0.9879492374960008, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:14:48.442: INFO @evaluate_embedding: best threshold 1.0373820066452026 2019-11-15 14:14:48.530: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:14:48.530: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:14:48.805: INFO @decay_lr : LR updated to `0.00019908189` 2019-11-15 14:14:48.807: INFO @log_profile : T train: 47.621303 2019-11-15 14:14:48.807: INFO @log_profile : T valid: 1.479823 2019-11-15 14:14:48.807: INFO @log_profile : T read data: 86.221394 2019-11-15 14:14:48.807: INFO @log_profile : T hooks: 139.682852 2019-11-15 14:14:48.808: INFO @main_loop : Epoch 322 done 2019-11-15 14:14:48.808: INFO @main_loop : Training epoch 323 2019-11-15 14:17:11.333: INFO @log_variables: train loss nanmean: 0.036556 2019-11-15 14:17:11.333: INFO @log_variables: train positive_distance nanmean: 0.556582 2019-11-15 14:17:11.333: INFO @log_variables: train negative_distance nanmean: 1.419423 2019-11-15 14:17:11.334: INFO @log_variables: valid loss nanmean: 0.275686 2019-11-15 14:17:11.334: INFO @log_variables: valid positive_distance nanmean: 0.675981 2019-11-15 14:17:11.334: INFO @log_variables: valid negative_distance nanmean: 1.400605 2019-11-15 14:17:11.334: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:19:26.353: INFO @metrics_hook: train matching accuracy: 0.9922236689814815, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-15 14:19:27.566: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:19:27.811: INFO @evaluate_embedding: best threshold 1.038292795419693 2019-11-15 14:19:27.896: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:19:27.896: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:19:28.138: INFO @decay_lr : LR updated to `0.00019808648` 2019-11-15 14:19:28.140: INFO @log_profile : T train: 47.251360 2019-11-15 14:19:28.140: INFO @log_profile : T valid: 1.520828 2019-11-15 14:19:28.140: INFO @log_profile : T read data: 87.601763 2019-11-15 14:19:28.140: INFO @log_profile : T hooks: 142.877468 2019-11-15 14:19:28.140: INFO @main_loop : Epoch 323 done 2019-11-15 14:19:28.140: INFO @main_loop : Training epoch 324 2019-11-15 14:21:55.092: INFO @log_variables: train loss nanmean: 0.036989 2019-11-15 14:21:55.092: INFO @log_variables: train positive_distance nanmean: 0.556407 2019-11-15 14:21:55.092: INFO @log_variables: train negative_distance nanmean: 1.419390 2019-11-15 14:21:55.092: INFO @log_variables: valid loss nanmean: 0.274601 2019-11-15 14:21:55.092: INFO @log_variables: valid positive_distance nanmean: 0.677348 2019-11-15 14:21:55.092: INFO @log_variables: valid negative_distance nanmean: 1.400402 2019-11-15 14:21:55.093: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:24:07.514: INFO @metrics_hook: train matching accuracy: 0.9924586991708186, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-15 14:24:08.808: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:24:09.052: INFO @evaluate_embedding: best threshold 1.0388750731945038 2019-11-15 14:24:09.150: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:24:09.150: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:24:09.408: INFO @decay_lr : LR updated to `0.00019709604` 2019-11-15 14:24:09.410: INFO @log_profile : T train: 46.253364 2019-11-15 14:24:09.410: INFO @log_profile : T valid: 1.356565 2019-11-15 14:24:09.410: INFO @log_profile : T read data: 93.587799 2019-11-15 14:24:09.410: INFO @log_profile : T hooks: 140.003234 2019-11-15 14:24:09.410: INFO @main_loop : Epoch 324 done 2019-11-15 14:24:09.410: INFO @main_loop : Training epoch 325 2019-11-15 14:26:33.451: INFO @log_variables: train loss nanmean: 0.036333 2019-11-15 14:26:33.451: INFO @log_variables: train positive_distance nanmean: 0.556076 2019-11-15 14:26:33.451: INFO @log_variables: train negative_distance nanmean: 1.419394 2019-11-15 14:26:33.452: INFO @log_variables: valid loss nanmean: 0.274571 2019-11-15 14:26:33.452: INFO @log_variables: valid positive_distance nanmean: 0.677258 2019-11-15 14:26:33.452: INFO @log_variables: valid negative_distance nanmean: 1.400555 2019-11-15 14:26:33.452: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:28:50.064: INFO @metrics_hook: train matching accuracy: 0.9927751806204845, N=110591, DB_SIZE=110592, N_IDS=7306 2019-11-15 14:28:51.114: INFO @metrics_hook: valid matching accuracy: 0.9882691692438946, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:28:51.271: INFO @evaluate_embedding: best threshold 1.0389067828655245 2019-11-15 14:28:51.333: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:28:51.333: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:28:51.496: INFO @decay_lr : LR updated to `0.00019611056` 2019-11-15 14:28:51.497: INFO @log_profile : T train: 46.307027 2019-11-15 14:28:51.497: INFO @log_profile : T valid: 1.347064 2019-11-15 14:28:51.497: INFO @log_profile : T read data: 90.637475 2019-11-15 14:28:51.497: INFO @log_profile : T hooks: 143.700570 2019-11-15 14:28:51.497: INFO @main_loop : Epoch 325 done 2019-11-15 14:28:51.497: INFO @main_loop : Training epoch 326 2019-11-15 14:31:17.604: INFO @log_variables: train loss nanmean: 0.037145 2019-11-15 14:31:17.604: INFO @log_variables: train positive_distance nanmean: 0.555553 2019-11-15 14:31:17.604: INFO @log_variables: train negative_distance nanmean: 1.419407 2019-11-15 14:31:17.604: INFO @log_variables: valid loss nanmean: 0.274096 2019-11-15 14:31:17.604: INFO @log_variables: valid positive_distance nanmean: 0.673850 2019-11-15 14:31:17.605: INFO @log_variables: valid negative_distance nanmean: 1.399775 2019-11-15 14:31:17.605: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:33:32.604: INFO @metrics_hook: train matching accuracy: 0.9924768518518519, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 14:33:33.854: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:33:33.994: INFO @evaluate_embedding: best threshold 1.0368126630783083 2019-11-15 14:33:34.072: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:33:34.072: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:33:34.274: INFO @decay_lr : LR updated to `0.00019513001` 2019-11-15 14:33:34.276: INFO @log_profile : T train: 45.793224 2019-11-15 14:33:34.276: INFO @log_profile : T valid: 1.514623 2019-11-15 14:33:34.276: INFO @log_profile : T read data: 90.982392 2019-11-15 14:33:34.276: INFO @log_profile : T hooks: 144.416853 2019-11-15 14:33:34.276: INFO @main_loop : Epoch 326 done 2019-11-15 14:33:34.276: INFO @main_loop : Training epoch 327 2019-11-15 14:35:57.540: INFO @log_variables: train loss nanmean: 0.036554 2019-11-15 14:35:57.540: INFO @log_variables: train positive_distance nanmean: 0.555213 2019-11-15 14:35:57.540: INFO @log_variables: train negative_distance nanmean: 1.419377 2019-11-15 14:35:57.541: INFO @log_variables: valid loss nanmean: 0.275017 2019-11-15 14:35:57.541: INFO @log_variables: valid positive_distance nanmean: 0.677243 2019-11-15 14:35:57.541: INFO @log_variables: valid negative_distance nanmean: 1.400577 2019-11-15 14:35:57.541: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:38:13.860: INFO @metrics_hook: train matching accuracy: 0.9930554927616171, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-15 14:38:15.123: INFO @metrics_hook: valid matching accuracy: 0.9879492374960008, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:38:15.306: INFO @evaluate_embedding: best threshold 1.0389098823070526 2019-11-15 14:38:15.384: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:38:15.384: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:38:15.596: INFO @decay_lr : LR updated to `0.00019415436` 2019-11-15 14:38:15.598: INFO @log_profile : T train: 45.956204 2019-11-15 14:38:15.598: INFO @log_profile : T valid: 1.515858 2019-11-15 14:38:15.598: INFO @log_profile : T read data: 87.184015 2019-11-15 14:38:15.598: INFO @log_profile : T hooks: 146.591520 2019-11-15 14:38:15.598: INFO @main_loop : Epoch 327 done 2019-11-15 14:38:15.598: INFO @main_loop : Training epoch 328 2019-11-15 14:40:34.992: INFO @log_variables: train loss nanmean: 0.036282 2019-11-15 14:40:34.992: INFO @log_variables: train positive_distance nanmean: 0.554864 2019-11-15 14:40:34.992: INFO @log_variables: train negative_distance nanmean: 1.419396 2019-11-15 14:40:34.992: INFO @log_variables: valid loss nanmean: 0.275920 2019-11-15 14:40:34.992: INFO @log_variables: valid positive_distance nanmean: 0.676505 2019-11-15 14:40:34.992: INFO @log_variables: valid negative_distance nanmean: 1.400503 2019-11-15 14:40:34.993: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:42:51.950: INFO @metrics_hook: train matching accuracy: 0.9931278935185185, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-15 14:42:53.868: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:42:54.072: INFO @evaluate_embedding: best threshold 1.0385037660598755 2019-11-15 14:42:54.162: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:42:54.166: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:42:54.419: INFO @decay_lr : LR updated to `0.00019318359` 2019-11-15 14:42:54.421: INFO @log_profile : T train: 45.971795 2019-11-15 14:42:54.421: INFO @log_profile : T valid: 1.469942 2019-11-15 14:42:54.422: INFO @log_profile : T read data: 83.012034 2019-11-15 14:42:54.422: INFO @log_profile : T hooks: 148.296107 2019-11-15 14:42:54.422: INFO @main_loop : Epoch 328 done 2019-11-15 14:42:54.422: INFO @main_loop : Training epoch 329 2019-11-15 14:45:24.986: INFO @log_variables: train loss nanmean: 0.036520 2019-11-15 14:45:24.986: INFO @log_variables: train positive_distance nanmean: 0.555643 2019-11-15 14:45:24.986: INFO @log_variables: train negative_distance nanmean: 1.419416 2019-11-15 14:45:24.986: INFO @log_variables: valid loss nanmean: 0.274340 2019-11-15 14:45:24.986: INFO @log_variables: valid positive_distance nanmean: 0.677968 2019-11-15 14:45:24.987: INFO @log_variables: valid negative_distance nanmean: 1.400010 2019-11-15 14:45:24.987: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:47:45.326: INFO @metrics_hook: train matching accuracy: 0.9930193865740741, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-15 14:47:46.534: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:47:46.697: INFO @evaluate_embedding: best threshold 1.0389891266822815 2019-11-15 14:47:46.763: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:47:46.763: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:47:46.954: INFO @decay_lr : LR updated to `0.00019221767` 2019-11-15 14:47:46.956: INFO @log_profile : T train: 46.617012 2019-11-15 14:47:46.956: INFO @log_profile : T valid: 1.449793 2019-11-15 14:47:46.956: INFO @log_profile : T read data: 93.731595 2019-11-15 14:47:46.956: INFO @log_profile : T hooks: 150.660152 2019-11-15 14:47:46.956: INFO @main_loop : Epoch 329 done 2019-11-15 14:47:46.956: INFO @main_loop : Training epoch 330 2019-11-15 14:49:57.661: INFO @log_variables: train loss nanmean: 0.035883 2019-11-15 14:49:57.661: INFO @log_variables: train positive_distance nanmean: 0.555473 2019-11-15 14:49:57.662: INFO @log_variables: train negative_distance nanmean: 1.419426 2019-11-15 14:49:57.662: INFO @log_variables: valid loss nanmean: 0.274979 2019-11-15 14:49:57.662: INFO @log_variables: valid positive_distance nanmean: 0.675886 2019-11-15 14:49:57.662: INFO @log_variables: valid negative_distance nanmean: 1.400656 2019-11-15 14:49:57.662: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:52:15.905: INFO @metrics_hook: train matching accuracy: 0.9933720341435185, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 14:52:17.105: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:52:17.319: INFO @evaluate_embedding: best threshold 1.0382709801197052 2019-11-15 14:52:17.398: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:52:17.398: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:52:17.657: INFO @decay_lr : LR updated to `0.0001912566` 2019-11-15 14:52:17.659: INFO @log_profile : T train: 45.331418 2019-11-15 14:52:17.659: INFO @log_profile : T valid: 1.459476 2019-11-15 14:52:17.659: INFO @log_profile : T read data: 75.834714 2019-11-15 14:52:17.659: INFO @log_profile : T hooks: 147.998192 2019-11-15 14:52:17.659: INFO @main_loop : Epoch 330 done 2019-11-15 14:52:17.659: INFO @main_loop : Training epoch 331 2019-11-15 14:54:37.460: INFO @log_variables: train loss nanmean: 0.035527 2019-11-15 14:54:37.461: INFO @log_variables: train positive_distance nanmean: 0.555165 2019-11-15 14:54:37.461: INFO @log_variables: train negative_distance nanmean: 1.419409 2019-11-15 14:54:37.461: INFO @log_variables: valid loss nanmean: 0.274617 2019-11-15 14:54:37.461: INFO @log_variables: valid positive_distance nanmean: 0.674923 2019-11-15 14:54:37.462: INFO @log_variables: valid negative_distance nanmean: 1.400135 2019-11-15 14:54:37.462: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:56:59.775: INFO @metrics_hook: train matching accuracy: 0.9924315037525997, N=110590, DB_SIZE=110592, N_IDS=7309 2019-11-15 14:57:00.649: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:57:00.785: INFO @evaluate_embedding: best threshold 1.0375290811061861 2019-11-15 14:57:00.849: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 14:57:00.849: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 14:57:01.023: INFO @decay_lr : LR updated to `0.00019030031` 2019-11-15 14:57:01.025: INFO @log_profile : T train: 45.271233 2019-11-15 14:57:01.025: INFO @log_profile : T valid: 1.521685 2019-11-15 14:57:01.025: INFO @log_profile : T read data: 83.721546 2019-11-15 14:57:01.025: INFO @log_profile : T hooks: 152.777925 2019-11-15 14:57:01.025: INFO @main_loop : Epoch 331 done 2019-11-15 14:57:01.025: INFO @main_loop : Training epoch 332 2019-11-15 14:58:23.706: INFO @log_variables: train loss nanmean: 0.035470 2019-11-15 14:58:23.707: INFO @log_variables: train positive_distance nanmean: 0.555642 2019-11-15 14:58:23.707: INFO @log_variables: train negative_distance nanmean: 1.419396 2019-11-15 14:58:23.707: INFO @log_variables: valid loss nanmean: 0.272851 2019-11-15 14:58:23.707: INFO @log_variables: valid positive_distance nanmean: 0.674917 2019-11-15 14:58:23.707: INFO @log_variables: valid negative_distance nanmean: 1.400493 2019-11-15 14:58:23.707: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 14:59:58.987: INFO @metrics_hook: train matching accuracy: 0.9922960069444444, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 14:59:59.810: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 14:59:59.969: INFO @evaluate_embedding: best threshold 1.0377050042152405 2019-11-15 15:00:00.037: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:00:00.037: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:00:00.222: INFO @decay_lr : LR updated to `0.00018934881` 2019-11-15 15:00:00.224: INFO @log_profile : T train: 42.983321 2019-11-15 15:00:00.224: INFO @log_profile : T valid: 1.304497 2019-11-15 15:00:00.224: INFO @log_profile : T read data: 33.411792 2019-11-15 15:00:00.224: INFO @log_profile : T hooks: 101.431270 2019-11-15 15:00:00.224: INFO @main_loop : Epoch 332 done 2019-11-15 15:00:00.224: INFO @main_loop : Training epoch 333 2019-11-15 15:01:26.865: INFO @log_variables: train loss nanmean: 0.036376 2019-11-15 15:01:26.865: INFO @log_variables: train positive_distance nanmean: 0.555684 2019-11-15 15:01:26.865: INFO @log_variables: train negative_distance nanmean: 1.419408 2019-11-15 15:01:26.865: INFO @log_variables: valid loss nanmean: 0.271821 2019-11-15 15:01:26.865: INFO @log_variables: valid positive_distance nanmean: 0.676052 2019-11-15 15:01:26.865: INFO @log_variables: valid negative_distance nanmean: 1.400758 2019-11-15 15:01:26.865: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:03:02.866: INFO @metrics_hook: train matching accuracy: 0.9920427521226863, N=110591, DB_SIZE=110592, N_IDS=7314 2019-11-15 15:03:03.761: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:03:03.954: INFO @evaluate_embedding: best threshold 1.038404792547226 2019-11-15 15:03:04.027: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:03:04.027: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:03:04.209: INFO @decay_lr : LR updated to `0.00018840206` 2019-11-15 15:03:04.211: INFO @log_profile : T train: 43.051953 2019-11-15 15:03:04.211: INFO @log_profile : T valid: 1.306877 2019-11-15 15:03:04.212: INFO @log_profile : T read data: 37.244108 2019-11-15 15:03:04.212: INFO @log_profile : T hooks: 102.316628 2019-11-15 15:03:04.212: INFO @main_loop : Epoch 333 done 2019-11-15 15:03:04.212: INFO @main_loop : Training epoch 334 2019-11-15 15:04:27.763: INFO @log_variables: train loss nanmean: 0.035860 2019-11-15 15:04:27.764: INFO @log_variables: train positive_distance nanmean: 0.556360 2019-11-15 15:04:27.764: INFO @log_variables: train negative_distance nanmean: 1.419395 2019-11-15 15:04:27.764: INFO @log_variables: valid loss nanmean: 0.271163 2019-11-15 15:04:27.764: INFO @log_variables: valid positive_distance nanmean: 0.676421 2019-11-15 15:04:27.764: INFO @log_variables: valid negative_distance nanmean: 1.400597 2019-11-15 15:04:27.764: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:06:03.065: INFO @metrics_hook: train matching accuracy: 0.9922778526281524, N=110591, DB_SIZE=110592, N_IDS=7324 2019-11-15 15:06:03.835: INFO @metrics_hook: valid matching accuracy: 0.9885891009917884, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:06:03.999: INFO @evaluate_embedding: best threshold 1.0385090112686157 2019-11-15 15:06:04.061: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:06:04.061: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:06:04.236: INFO @decay_lr : LR updated to `0.00018746006` 2019-11-15 15:06:04.238: INFO @log_profile : T train: 42.868488 2019-11-15 15:06:04.238: INFO @log_profile : T valid: 1.293848 2019-11-15 15:06:04.238: INFO @log_profile : T read data: 34.181523 2019-11-15 15:06:04.238: INFO @log_profile : T hooks: 101.614788 2019-11-15 15:06:04.238: INFO @main_loop : Epoch 334 done 2019-11-15 15:06:04.238: INFO @main_loop : Training epoch 335 2019-11-15 15:07:30.408: INFO @log_variables: train loss nanmean: 0.036583 2019-11-15 15:07:30.408: INFO @log_variables: train positive_distance nanmean: 0.555353 2019-11-15 15:07:30.408: INFO @log_variables: train negative_distance nanmean: 1.419393 2019-11-15 15:07:30.408: INFO @log_variables: valid loss nanmean: 0.274711 2019-11-15 15:07:30.408: INFO @log_variables: valid positive_distance nanmean: 0.676266 2019-11-15 15:07:30.408: INFO @log_variables: valid negative_distance nanmean: 1.400314 2019-11-15 15:07:30.408: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:09:05.539: INFO @metrics_hook: train matching accuracy: 0.992431640625, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-15 15:09:06.487: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:09:06.669: INFO @evaluate_embedding: best threshold 1.0382903516292572 2019-11-15 15:09:06.746: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:09:06.746: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:09:06.928: INFO @decay_lr : LR updated to `0.00018652275` 2019-11-15 15:09:06.929: INFO @log_profile : T train: 43.239346 2019-11-15 15:09:06.930: INFO @log_profile : T valid: 1.305869 2019-11-15 15:09:06.930: INFO @log_profile : T read data: 36.457274 2019-11-15 15:09:06.930: INFO @log_profile : T hooks: 101.618684 2019-11-15 15:09:06.930: INFO @main_loop : Epoch 335 done 2019-11-15 15:09:06.930: INFO @main_loop : Training epoch 336 2019-11-15 15:10:30.284: INFO @log_variables: train loss nanmean: 0.036142 2019-11-15 15:10:30.285: INFO @log_variables: train positive_distance nanmean: 0.554630 2019-11-15 15:10:30.285: INFO @log_variables: train negative_distance nanmean: 1.419409 2019-11-15 15:10:30.285: INFO @log_variables: valid loss nanmean: 0.274965 2019-11-15 15:10:30.285: INFO @log_variables: valid positive_distance nanmean: 0.675452 2019-11-15 15:10:30.285: INFO @log_variables: valid negative_distance nanmean: 1.400313 2019-11-15 15:10:30.285: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:12:01.313: INFO @metrics_hook: train matching accuracy: 0.9922054435301564, N=110590, DB_SIZE=110592, N_IDS=7314 2019-11-15 15:12:01.982: INFO @metrics_hook: valid matching accuracy: 0.98816252532793, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:12:02.144: INFO @evaluate_embedding: best threshold 1.0378824472427368 2019-11-15 15:12:02.211: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:12:02.211: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:12:02.411: INFO @decay_lr : LR updated to `0.00018559014` 2019-11-15 15:12:02.413: INFO @log_profile : T train: 43.073214 2019-11-15 15:12:02.413: INFO @log_profile : T valid: 1.297427 2019-11-15 15:12:02.413: INFO @log_profile : T read data: 34.041880 2019-11-15 15:12:02.413: INFO @log_profile : T hooks: 97.002846 2019-11-15 15:12:02.413: INFO @main_loop : Epoch 336 done 2019-11-15 15:12:02.413: INFO @main_loop : Training epoch 337 2019-11-15 15:13:27.050: INFO @log_variables: train loss nanmean: 0.035153 2019-11-15 15:13:27.050: INFO @log_variables: train positive_distance nanmean: 0.554694 2019-11-15 15:13:27.050: INFO @log_variables: train negative_distance nanmean: 1.419425 2019-11-15 15:13:27.050: INFO @log_variables: valid loss nanmean: 0.274685 2019-11-15 15:13:27.050: INFO @log_variables: valid positive_distance nanmean: 0.676534 2019-11-15 15:13:27.051: INFO @log_variables: valid negative_distance nanmean: 1.400161 2019-11-15 15:13:27.051: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:15:01.407: INFO @metrics_hook: train matching accuracy: 0.9924858940972222, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 15:15:02.281: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:15:02.445: INFO @evaluate_embedding: best threshold 1.0383474230766296 2019-11-15 15:15:02.509: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:15:02.509: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:15:02.683: INFO @decay_lr : LR updated to `0.00018466219` 2019-11-15 15:15:02.685: INFO @log_profile : T train: 42.718392 2019-11-15 15:15:02.685: INFO @log_profile : T valid: 1.297271 2019-11-15 15:15:02.685: INFO @log_profile : T read data: 35.384455 2019-11-15 15:15:02.685: INFO @log_profile : T hooks: 100.804254 2019-11-15 15:15:02.685: INFO @main_loop : Epoch 337 done 2019-11-15 15:15:02.685: INFO @main_loop : Training epoch 338 2019-11-15 15:16:27.550: INFO @log_variables: train loss nanmean: 0.035141 2019-11-15 15:16:27.550: INFO @log_variables: train positive_distance nanmean: 0.555674 2019-11-15 15:16:27.550: INFO @log_variables: train negative_distance nanmean: 1.419410 2019-11-15 15:16:27.550: INFO @log_variables: valid loss nanmean: 0.276039 2019-11-15 15:16:27.550: INFO @log_variables: valid positive_distance nanmean: 0.676901 2019-11-15 15:16:27.550: INFO @log_variables: valid negative_distance nanmean: 1.400319 2019-11-15 15:16:27.551: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:18:01.817: INFO @metrics_hook: train matching accuracy: 0.9929017090152816, N=110590, DB_SIZE=110592, N_IDS=7309 2019-11-15 15:18:02.617: INFO @metrics_hook: valid matching accuracy: 0.98816252532793, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:18:02.760: INFO @evaluate_embedding: best threshold 1.0386096835136411 2019-11-15 15:18:02.819: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:18:02.819: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:18:02.982: INFO @decay_lr : LR updated to `0.00018373888` 2019-11-15 15:18:02.983: INFO @log_profile : T train: 43.094980 2019-11-15 15:18:02.984: INFO @log_profile : T valid: 1.305387 2019-11-15 15:18:02.984: INFO @log_profile : T read data: 35.160533 2019-11-15 15:18:02.984: INFO @log_profile : T hooks: 100.669298 2019-11-15 15:18:02.984: INFO @main_loop : Epoch 338 done 2019-11-15 15:18:02.984: INFO @main_loop : Training epoch 339 2019-11-15 15:19:29.193: INFO @log_variables: train loss nanmean: 0.035022 2019-11-15 15:19:29.194: INFO @log_variables: train positive_distance nanmean: 0.555527 2019-11-15 15:19:29.194: INFO @log_variables: train negative_distance nanmean: 1.419402 2019-11-15 15:19:29.194: INFO @log_variables: valid loss nanmean: 0.273509 2019-11-15 15:19:29.194: INFO @log_variables: valid positive_distance nanmean: 0.675116 2019-11-15 15:19:29.194: INFO @log_variables: valid negative_distance nanmean: 1.400457 2019-11-15 15:19:29.194: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:21:04.526: INFO @metrics_hook: train matching accuracy: 0.9923773871527778, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-15 15:21:05.261: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:21:05.418: INFO @evaluate_embedding: best threshold 1.0377863943576815 2019-11-15 15:21:05.483: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:21:05.483: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:21:05.665: INFO @decay_lr : LR updated to `0.0001828202` 2019-11-15 15:21:05.666: INFO @log_profile : T train: 42.829134 2019-11-15 15:21:05.666: INFO @log_profile : T valid: 1.302519 2019-11-15 15:21:05.666: INFO @log_profile : T read data: 36.805545 2019-11-15 15:21:05.666: INFO @log_profile : T hooks: 101.676484 2019-11-15 15:21:05.666: INFO @main_loop : Epoch 339 done 2019-11-15 15:21:05.666: INFO @main_loop : Training epoch 340 2019-11-15 15:22:29.038: INFO @log_variables: train loss nanmean: 0.035325 2019-11-15 15:22:29.038: INFO @log_variables: train positive_distance nanmean: 0.554794 2019-11-15 15:22:29.039: INFO @log_variables: train negative_distance nanmean: 1.419415 2019-11-15 15:22:29.039: INFO @log_variables: valid loss nanmean: 0.272625 2019-11-15 15:22:29.039: INFO @log_variables: valid positive_distance nanmean: 0.674520 2019-11-15 15:22:29.039: INFO @log_variables: valid negative_distance nanmean: 1.400125 2019-11-15 15:22:29.039: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:24:03.263: INFO @metrics_hook: train matching accuracy: 0.9930465133101852, N=110592, DB_SIZE=110592, N_IDS=7298 2019-11-15 15:24:04.284: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:24:04.444: INFO @evaluate_embedding: best threshold 1.037322610616684 2019-11-15 15:24:04.516: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:24:04.516: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:24:04.685: INFO @decay_lr : LR updated to `0.00018190609` 2019-11-15 15:24:04.686: INFO @log_profile : T train: 42.866553 2019-11-15 15:24:04.686: INFO @log_profile : T valid: 1.297710 2019-11-15 15:24:04.686: INFO @log_profile : T read data: 34.213951 2019-11-15 15:24:04.686: INFO @log_profile : T hooks: 100.572982 2019-11-15 15:24:04.686: INFO @main_loop : Epoch 340 done 2019-11-15 15:24:04.686: INFO @main_loop : Training epoch 341 2019-11-15 15:25:27.205: INFO @log_variables: train loss nanmean: 0.035447 2019-11-15 15:25:27.206: INFO @log_variables: train positive_distance nanmean: 0.554587 2019-11-15 15:25:27.206: INFO @log_variables: train negative_distance nanmean: 1.419396 2019-11-15 15:25:27.206: INFO @log_variables: valid loss nanmean: 0.275970 2019-11-15 15:25:27.206: INFO @log_variables: valid positive_distance nanmean: 0.676853 2019-11-15 15:25:27.206: INFO @log_variables: valid negative_distance nanmean: 1.399950 2019-11-15 15:25:27.206: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:27:03.963: INFO @metrics_hook: train matching accuracy: 0.9924225983796297, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-15 15:27:04.772: INFO @metrics_hook: valid matching accuracy: 0.9879492374960008, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:27:04.932: INFO @evaluate_embedding: best threshold 1.0384012758731842 2019-11-15 15:27:05.009: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:27:05.009: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:27:05.177: INFO @decay_lr : LR updated to `0.00018099656` 2019-11-15 15:27:05.179: INFO @log_profile : T train: 42.737690 2019-11-15 15:27:05.179: INFO @log_profile : T valid: 1.310044 2019-11-15 15:27:05.179: INFO @log_profile : T read data: 33.368355 2019-11-15 15:27:05.179: INFO @log_profile : T hooks: 103.008889 2019-11-15 15:27:05.179: INFO @main_loop : Epoch 341 done 2019-11-15 15:27:05.179: INFO @main_loop : Training epoch 342 2019-11-15 15:28:31.268: INFO @log_variables: train loss nanmean: 0.036265 2019-11-15 15:28:31.268: INFO @log_variables: train positive_distance nanmean: 0.555321 2019-11-15 15:28:31.268: INFO @log_variables: train negative_distance nanmean: 1.419397 2019-11-15 15:28:31.268: INFO @log_variables: valid loss nanmean: 0.275496 2019-11-15 15:28:31.268: INFO @log_variables: valid positive_distance nanmean: 0.676789 2019-11-15 15:28:31.268: INFO @log_variables: valid negative_distance nanmean: 1.400372 2019-11-15 15:28:31.268: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:30:06.262: INFO @metrics_hook: train matching accuracy: 0.9924225983796297, N=110592, DB_SIZE=110592, N_IDS=7304 2019-11-15 15:30:07.138: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:30:07.306: INFO @evaluate_embedding: best threshold 1.0385807752609255 2019-11-15 15:30:07.370: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:30:07.370: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:30:07.557: INFO @decay_lr : LR updated to `0.00018009158` 2019-11-15 15:30:07.558: INFO @log_profile : T train: 42.834526 2019-11-15 15:30:07.559: INFO @log_profile : T valid: 1.297130 2019-11-15 15:30:07.559: INFO @log_profile : T read data: 36.818975 2019-11-15 15:30:07.559: INFO @log_profile : T hooks: 101.360835 2019-11-15 15:30:07.559: INFO @main_loop : Epoch 342 done 2019-11-15 15:30:07.559: INFO @main_loop : Training epoch 343 2019-11-15 15:31:30.759: INFO @log_variables: train loss nanmean: 0.036747 2019-11-15 15:31:30.759: INFO @log_variables: train positive_distance nanmean: 0.556414 2019-11-15 15:31:30.759: INFO @log_variables: train negative_distance nanmean: 1.419402 2019-11-15 15:31:30.759: INFO @log_variables: valid loss nanmean: 0.274514 2019-11-15 15:31:30.760: INFO @log_variables: valid positive_distance nanmean: 0.676288 2019-11-15 15:31:30.760: INFO @log_variables: valid negative_distance nanmean: 1.400658 2019-11-15 15:31:30.760: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:33:02.739: INFO @metrics_hook: train matching accuracy: 0.9926305700231481, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 15:33:03.592: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:33:03.749: INFO @evaluate_embedding: best threshold 1.0384727716445923 2019-11-15 15:33:03.818: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:33:03.818: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:33:03.985: INFO @decay_lr : LR updated to `0.00017919112` 2019-11-15 15:33:03.987: INFO @log_profile : T train: 42.835456 2019-11-15 15:33:03.987: INFO @log_profile : T valid: 1.302054 2019-11-15 15:33:03.987: INFO @log_profile : T read data: 34.027044 2019-11-15 15:33:03.987: INFO @log_profile : T hooks: 98.195155 2019-11-15 15:33:03.987: INFO @main_loop : Epoch 343 done 2019-11-15 15:33:03.987: INFO @main_loop : Training epoch 344 2019-11-15 15:34:29.680: INFO @log_variables: train loss nanmean: 0.036105 2019-11-15 15:34:29.680: INFO @log_variables: train positive_distance nanmean: 0.555712 2019-11-15 15:34:29.680: INFO @log_variables: train negative_distance nanmean: 1.419398 2019-11-15 15:34:29.680: INFO @log_variables: valid loss nanmean: 0.277679 2019-11-15 15:34:29.680: INFO @log_variables: valid positive_distance nanmean: 0.676551 2019-11-15 15:34:29.680: INFO @log_variables: valid negative_distance nanmean: 1.400458 2019-11-15 15:34:29.680: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:36:05.083: INFO @metrics_hook: train matching accuracy: 0.9930013020833334, N=110592, DB_SIZE=110592, N_IDS=7320 2019-11-15 15:36:05.891: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:36:06.028: INFO @evaluate_embedding: best threshold 1.0385043323040009 2019-11-15 15:36:06.094: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:36:06.094: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:36:06.309: INFO @decay_lr : LR updated to `0.00017829516` 2019-11-15 15:36:06.311: INFO @log_profile : T train: 42.906625 2019-11-15 15:36:06.311: INFO @log_profile : T valid: 1.298266 2019-11-15 15:36:06.311: INFO @log_profile : T read data: 36.397359 2019-11-15 15:36:06.311: INFO @log_profile : T hooks: 101.653662 2019-11-15 15:36:06.311: INFO @main_loop : Epoch 344 done 2019-11-15 15:36:06.311: INFO @main_loop : Training epoch 345 2019-11-15 15:37:29.942: INFO @log_variables: train loss nanmean: 0.034789 2019-11-15 15:37:29.942: INFO @log_variables: train positive_distance nanmean: 0.555399 2019-11-15 15:37:29.942: INFO @log_variables: train negative_distance nanmean: 1.419411 2019-11-15 15:37:29.942: INFO @log_variables: valid loss nanmean: 0.277906 2019-11-15 15:37:29.942: INFO @log_variables: valid positive_distance nanmean: 0.678089 2019-11-15 15:37:29.942: INFO @log_variables: valid negative_distance nanmean: 1.400646 2019-11-15 15:37:29.942: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:39:05.563: INFO @metrics_hook: train matching accuracy: 0.9917173032407407, N=110592, DB_SIZE=110592, N_IDS=7307 2019-11-15 15:39:06.476: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:39:06.632: INFO @evaluate_embedding: best threshold 1.0393675267696383 2019-11-15 15:39:06.699: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:39:06.699: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:39:06.872: INFO @decay_lr : LR updated to `0.00017740368` 2019-11-15 15:39:06.873: INFO @log_profile : T train: 42.823885 2019-11-15 15:39:06.873: INFO @log_profile : T valid: 1.297562 2019-11-15 15:39:06.873: INFO @log_profile : T read data: 34.433503 2019-11-15 15:39:06.873: INFO @log_profile : T hooks: 101.939228 2019-11-15 15:39:06.873: INFO @main_loop : Epoch 345 done 2019-11-15 15:39:06.874: INFO @main_loop : Training epoch 346 2019-11-15 15:40:32.515: INFO @log_variables: train loss nanmean: 0.036114 2019-11-15 15:40:32.516: INFO @log_variables: train positive_distance nanmean: 0.555364 2019-11-15 15:40:32.516: INFO @log_variables: train negative_distance nanmean: 1.419400 2019-11-15 15:40:32.516: INFO @log_variables: valid loss nanmean: 0.275165 2019-11-15 15:40:32.516: INFO @log_variables: valid positive_distance nanmean: 0.676719 2019-11-15 15:40:32.516: INFO @log_variables: valid negative_distance nanmean: 1.400420 2019-11-15 15:40:32.516: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:42:07.593: INFO @metrics_hook: train matching accuracy: 0.9917805989583334, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 15:42:08.441: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:42:08.603: INFO @evaluate_embedding: best threshold 1.0385695993900301 2019-11-15 15:42:08.668: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:42:08.669: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:42:08.848: INFO @decay_lr : LR updated to `0.00017651667` 2019-11-15 15:42:08.850: INFO @log_profile : T train: 42.702146 2019-11-15 15:42:08.850: INFO @log_profile : T valid: 1.299382 2019-11-15 15:42:08.850: INFO @log_profile : T read data: 36.337019 2019-11-15 15:42:08.850: INFO @log_profile : T hooks: 101.570137 2019-11-15 15:42:08.850: INFO @main_loop : Epoch 346 done 2019-11-15 15:42:08.850: INFO @main_loop : Training epoch 347 2019-11-15 15:43:32.300: INFO @log_variables: train loss nanmean: 0.035957 2019-11-15 15:43:32.300: INFO @log_variables: train positive_distance nanmean: 0.556266 2019-11-15 15:43:32.300: INFO @log_variables: train negative_distance nanmean: 1.419404 2019-11-15 15:43:32.300: INFO @log_variables: valid loss nanmean: 0.277448 2019-11-15 15:43:32.300: INFO @log_variables: valid positive_distance nanmean: 0.675321 2019-11-15 15:43:32.301: INFO @log_variables: valid negative_distance nanmean: 1.400011 2019-11-15 15:43:32.301: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:45:05.746: INFO @metrics_hook: train matching accuracy: 0.9926938657407407, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 15:45:06.788: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:45:06.955: INFO @evaluate_embedding: best threshold 1.0376661419868467 2019-11-15 15:45:07.022: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:45:07.022: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:45:07.200: INFO @decay_lr : LR updated to `0.00017563408` 2019-11-15 15:45:07.202: INFO @log_profile : T train: 42.820037 2019-11-15 15:45:07.202: INFO @log_profile : T valid: 1.302132 2019-11-15 15:45:07.202: INFO @log_profile : T read data: 34.118558 2019-11-15 15:45:07.202: INFO @log_profile : T hooks: 100.043786 2019-11-15 15:45:07.202: INFO @main_loop : Epoch 347 done 2019-11-15 15:45:07.202: INFO @main_loop : Training epoch 348 2019-11-15 15:46:31.282: INFO @log_variables: train loss nanmean: 0.035349 2019-11-15 15:46:31.282: INFO @log_variables: train positive_distance nanmean: 0.555139 2019-11-15 15:46:31.282: INFO @log_variables: train negative_distance nanmean: 1.419409 2019-11-15 15:46:31.282: INFO @log_variables: valid loss nanmean: 0.278147 2019-11-15 15:46:31.283: INFO @log_variables: valid positive_distance nanmean: 0.676684 2019-11-15 15:46:31.283: INFO @log_variables: valid negative_distance nanmean: 1.400304 2019-11-15 15:46:31.283: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:48:02.922: INFO @metrics_hook: train matching accuracy: 0.9925401475694444, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 15:48:03.899: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:48:04.058: INFO @evaluate_embedding: best threshold 1.038494259119034 2019-11-15 15:48:04.144: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:48:04.144: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:48:04.334: INFO @decay_lr : LR updated to `0.00017475591` 2019-11-15 15:48:04.335: INFO @log_profile : T train: 42.836275 2019-11-15 15:48:04.335: INFO @log_profile : T valid: 1.292739 2019-11-15 15:48:04.335: INFO @log_profile : T read data: 34.774300 2019-11-15 15:48:04.335: INFO @log_profile : T hooks: 98.162704 2019-11-15 15:48:04.336: INFO @main_loop : Epoch 348 done 2019-11-15 15:48:04.336: INFO @main_loop : Training epoch 349 2019-11-15 15:49:29.435: INFO @log_variables: train loss nanmean: 0.035476 2019-11-15 15:49:29.435: INFO @log_variables: train positive_distance nanmean: 0.554743 2019-11-15 15:49:29.436: INFO @log_variables: train negative_distance nanmean: 1.419420 2019-11-15 15:49:29.436: INFO @log_variables: valid loss nanmean: 0.280903 2019-11-15 15:49:29.436: INFO @log_variables: valid positive_distance nanmean: 0.677819 2019-11-15 15:49:29.436: INFO @log_variables: valid negative_distance nanmean: 1.400681 2019-11-15 15:49:29.436: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:51:03.206: INFO @metrics_hook: train matching accuracy: 0.9923049100280315, N=110590, DB_SIZE=110592, N_IDS=7311 2019-11-15 15:51:04.031: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:51:04.192: INFO @evaluate_embedding: best threshold 1.039250135421753 2019-11-15 15:51:04.256: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:51:04.256: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:51:04.431: INFO @decay_lr : LR updated to `0.00017388213` 2019-11-15 15:51:04.432: INFO @log_profile : T train: 42.915752 2019-11-15 15:51:04.432: INFO @log_profile : T valid: 1.299901 2019-11-15 15:51:04.432: INFO @log_profile : T read data: 35.711325 2019-11-15 15:51:04.432: INFO @log_profile : T hooks: 100.101923 2019-11-15 15:51:04.432: INFO @main_loop : Epoch 349 done 2019-11-15 15:51:04.432: INFO @main_loop : Training epoch 350 2019-11-15 15:52:29.352: INFO @log_variables: train loss nanmean: 0.034430 2019-11-15 15:52:29.352: INFO @log_variables: train positive_distance nanmean: 0.554486 2019-11-15 15:52:29.352: INFO @log_variables: train negative_distance nanmean: 1.419401 2019-11-15 15:52:29.352: INFO @log_variables: valid loss nanmean: 0.275616 2019-11-15 15:52:29.352: INFO @log_variables: valid positive_distance nanmean: 0.676975 2019-11-15 15:52:29.352: INFO @log_variables: valid negative_distance nanmean: 1.400503 2019-11-15 15:52:29.352: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:54:02.449: INFO @metrics_hook: train matching accuracy: 0.9922417534722222, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 15:54:03.222: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:54:03.398: INFO @evaluate_embedding: best threshold 1.0387390553951263 2019-11-15 15:54:03.458: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:54:03.459: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:54:03.629: INFO @decay_lr : LR updated to `0.00017301273` 2019-11-15 15:54:03.630: INFO @log_profile : T train: 42.833325 2019-11-15 15:54:03.630: INFO @log_profile : T valid: 1.299101 2019-11-15 15:54:03.630: INFO @log_profile : T read data: 35.691289 2019-11-15 15:54:03.630: INFO @log_profile : T hooks: 99.305139 2019-11-15 15:54:03.630: INFO @main_loop : Epoch 350 done 2019-11-15 15:54:03.630: INFO @main_loop : Training epoch 351 2019-11-15 15:55:27.694: INFO @log_variables: train loss nanmean: 0.035442 2019-11-15 15:55:27.695: INFO @log_variables: train positive_distance nanmean: 0.555511 2019-11-15 15:55:27.695: INFO @log_variables: train negative_distance nanmean: 1.419410 2019-11-15 15:55:27.695: INFO @log_variables: valid loss nanmean: 0.275777 2019-11-15 15:55:27.695: INFO @log_variables: valid positive_distance nanmean: 0.676532 2019-11-15 15:55:27.695: INFO @log_variables: valid negative_distance nanmean: 1.400362 2019-11-15 15:55:27.695: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 15:57:02.647: INFO @metrics_hook: train matching accuracy: 0.9923864293981481, N=110592, DB_SIZE=110592, N_IDS=7327 2019-11-15 15:57:03.453: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 15:57:03.599: INFO @evaluate_embedding: best threshold 1.0384467840194704 2019-11-15 15:57:03.667: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 15:57:03.667: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 15:57:03.843: INFO @decay_lr : LR updated to `0.00017214766` 2019-11-15 15:57:03.845: INFO @log_profile : T train: 42.716879 2019-11-15 15:57:03.845: INFO @log_profile : T valid: 1.301043 2019-11-15 15:57:03.845: INFO @log_profile : T read data: 34.863214 2019-11-15 15:57:03.845: INFO @log_profile : T hooks: 101.263654 2019-11-15 15:57:03.845: INFO @main_loop : Epoch 351 done 2019-11-15 15:57:03.845: INFO @main_loop : Training epoch 352 2019-11-15 15:58:27.508: INFO @log_variables: train loss nanmean: 0.035760 2019-11-15 15:58:27.508: INFO @log_variables: train positive_distance nanmean: 0.555365 2019-11-15 15:58:27.508: INFO @log_variables: train negative_distance nanmean: 1.419419 2019-11-15 15:58:27.508: INFO @log_variables: valid loss nanmean: 0.276155 2019-11-15 15:58:27.508: INFO @log_variables: valid positive_distance nanmean: 0.677170 2019-11-15 15:58:27.508: INFO @log_variables: valid negative_distance nanmean: 1.400328 2019-11-15 15:58:27.508: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:00:00.723: INFO @metrics_hook: train matching accuracy: 0.9925763165509259, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 16:00:01.723: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:00:01.873: INFO @evaluate_embedding: best threshold 1.0387489795684817 2019-11-15 16:00:01.941: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:00:01.941: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:00:02.113: INFO @decay_lr : LR updated to `0.00017128693` 2019-11-15 16:00:02.114: INFO @log_profile : T train: 42.798606 2019-11-15 16:00:02.114: INFO @log_profile : T valid: 1.301115 2019-11-15 16:00:02.114: INFO @log_profile : T read data: 34.530227 2019-11-15 16:00:02.114: INFO @log_profile : T hooks: 99.570258 2019-11-15 16:00:02.114: INFO @main_loop : Epoch 352 done 2019-11-15 16:00:02.114: INFO @main_loop : Training epoch 353 2019-11-15 16:01:27.825: INFO @log_variables: train loss nanmean: 0.035505 2019-11-15 16:01:27.825: INFO @log_variables: train positive_distance nanmean: 0.556281 2019-11-15 16:01:27.825: INFO @log_variables: train negative_distance nanmean: 1.419399 2019-11-15 16:01:27.825: INFO @log_variables: valid loss nanmean: 0.272739 2019-11-15 16:01:27.825: INFO @log_variables: valid positive_distance nanmean: 0.677122 2019-11-15 16:01:27.825: INFO @log_variables: valid negative_distance nanmean: 1.400442 2019-11-15 16:01:27.825: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:03:01.358: INFO @metrics_hook: train matching accuracy: 0.9917714079030654, N=110590, DB_SIZE=110592, N_IDS=7314 2019-11-15 16:03:02.310: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:03:02.482: INFO @evaluate_embedding: best threshold 1.0387816131114957 2019-11-15 16:03:02.543: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:03:02.543: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:03:02.699: INFO @decay_lr : LR updated to `0.00017043049` 2019-11-15 16:03:02.700: INFO @log_profile : T train: 42.682597 2019-11-15 16:03:02.700: INFO @log_profile : T valid: 1.297880 2019-11-15 16:03:02.701: INFO @log_profile : T read data: 36.601035 2019-11-15 16:03:02.701: INFO @log_profile : T hooks: 99.937448 2019-11-15 16:03:02.701: INFO @main_loop : Epoch 353 done 2019-11-15 16:03:02.701: INFO @main_loop : Training epoch 354 2019-11-15 16:04:26.802: INFO @log_variables: train loss nanmean: 0.034871 2019-11-15 16:04:26.802: INFO @log_variables: train positive_distance nanmean: 0.553866 2019-11-15 16:04:26.802: INFO @log_variables: train negative_distance nanmean: 1.419404 2019-11-15 16:04:26.802: INFO @log_variables: valid loss nanmean: 0.275484 2019-11-15 16:04:26.803: INFO @log_variables: valid positive_distance nanmean: 0.677733 2019-11-15 16:04:26.803: INFO @log_variables: valid negative_distance nanmean: 1.400613 2019-11-15 16:04:26.803: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:06:00.944: INFO @metrics_hook: train matching accuracy: 0.9918980748885533, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-15 16:06:01.829: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:06:01.983: INFO @evaluate_embedding: best threshold 1.0391733050346375 2019-11-15 16:06:02.060: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:06:02.060: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:06:02.238: INFO @decay_lr : LR updated to `0.00016957834` 2019-11-15 16:06:02.239: INFO @log_profile : T train: 42.729297 2019-11-15 16:06:02.239: INFO @log_profile : T valid: 1.297211 2019-11-15 16:06:02.239: INFO @log_profile : T read data: 34.902666 2019-11-15 16:06:02.239: INFO @log_profile : T hooks: 100.541495 2019-11-15 16:06:02.240: INFO @main_loop : Epoch 354 done 2019-11-15 16:06:02.240: INFO @main_loop : Training epoch 355 2019-11-15 16:07:28.788: INFO @log_variables: train loss nanmean: 0.035876 2019-11-15 16:07:28.788: INFO @log_variables: train positive_distance nanmean: 0.555988 2019-11-15 16:07:28.789: INFO @log_variables: train negative_distance nanmean: 1.419424 2019-11-15 16:07:28.789: INFO @log_variables: valid loss nanmean: 0.274273 2019-11-15 16:07:28.789: INFO @log_variables: valid positive_distance nanmean: 0.676540 2019-11-15 16:07:28.789: INFO @log_variables: valid negative_distance nanmean: 1.400398 2019-11-15 16:07:28.789: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:09:01.930: INFO @metrics_hook: train matching accuracy: 0.9923593026620371, N=110592, DB_SIZE=110592, N_IDS=7305 2019-11-15 16:09:02.833: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:09:02.986: INFO @evaluate_embedding: best threshold 1.0384690463542938 2019-11-15 16:09:03.056: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:09:03.056: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:09:03.231: INFO @decay_lr : LR updated to `0.00016873045` 2019-11-15 16:09:03.232: INFO @log_profile : T train: 42.740993 2019-11-15 16:09:03.232: INFO @log_profile : T valid: 1.319037 2019-11-15 16:09:03.233: INFO @log_profile : T read data: 37.143456 2019-11-15 16:09:03.233: INFO @log_profile : T hooks: 99.720588 2019-11-15 16:09:03.233: INFO @main_loop : Epoch 355 done 2019-11-15 16:09:03.233: INFO @main_loop : Training epoch 356 2019-11-15 16:10:27.829: INFO @log_variables: train loss nanmean: 0.035628 2019-11-15 16:10:27.829: INFO @log_variables: train positive_distance nanmean: 0.553926 2019-11-15 16:10:27.829: INFO @log_variables: train negative_distance nanmean: 1.419395 2019-11-15 16:10:27.829: INFO @log_variables: valid loss nanmean: 0.273631 2019-11-15 16:10:27.829: INFO @log_variables: valid positive_distance nanmean: 0.677688 2019-11-15 16:10:27.829: INFO @log_variables: valid negative_distance nanmean: 1.400559 2019-11-15 16:10:27.829: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:12:01.896: INFO @metrics_hook: train matching accuracy: 0.9921513310185185, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 16:12:02.969: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:12:03.146: INFO @evaluate_embedding: best threshold 1.0391233265399933 2019-11-15 16:12:03.214: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:12:03.214: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:12:03.395: INFO @decay_lr : LR updated to `0.0001678868` 2019-11-15 16:12:03.397: INFO @log_profile : T train: 42.792499 2019-11-15 16:12:03.397: INFO @log_profile : T valid: 1.296829 2019-11-15 16:12:03.397: INFO @log_profile : T read data: 35.250435 2019-11-15 16:12:03.397: INFO @log_profile : T hooks: 100.756337 2019-11-15 16:12:03.397: INFO @main_loop : Epoch 356 done 2019-11-15 16:12:03.397: INFO @main_loop : Training epoch 357 2019-11-15 16:13:28.188: INFO @log_variables: train loss nanmean: 0.034409 2019-11-15 16:13:28.188: INFO @log_variables: train positive_distance nanmean: 0.554374 2019-11-15 16:13:28.188: INFO @log_variables: train negative_distance nanmean: 1.419402 2019-11-15 16:13:28.188: INFO @log_variables: valid loss nanmean: 0.275390 2019-11-15 16:13:28.188: INFO @log_variables: valid positive_distance nanmean: 0.677794 2019-11-15 16:13:28.188: INFO @log_variables: valid negative_distance nanmean: 1.400357 2019-11-15 16:13:28.188: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:15:03.375: INFO @metrics_hook: train matching accuracy: 0.99274792248777, N=110589, DB_SIZE=110592, N_IDS=7311 2019-11-15 16:15:04.176: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:15:04.342: INFO @evaluate_embedding: best threshold 1.0390754342079163 2019-11-15 16:15:04.402: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:15:04.402: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:15:04.564: INFO @decay_lr : LR updated to `0.00016704737` 2019-11-15 16:15:04.565: INFO @log_profile : T train: 42.601185 2019-11-15 16:15:04.565: INFO @log_profile : T valid: 1.294007 2019-11-15 16:15:04.565: INFO @log_profile : T read data: 35.858095 2019-11-15 16:15:04.566: INFO @log_profile : T hooks: 101.346937 2019-11-15 16:15:04.566: INFO @main_loop : Epoch 357 done 2019-11-15 16:15:04.566: INFO @main_loop : Training epoch 358 2019-11-15 16:16:27.268: INFO @log_variables: train loss nanmean: 0.035197 2019-11-15 16:16:27.269: INFO @log_variables: train positive_distance nanmean: 0.555262 2019-11-15 16:16:27.269: INFO @log_variables: train negative_distance nanmean: 1.419415 2019-11-15 16:16:27.269: INFO @log_variables: valid loss nanmean: 0.275735 2019-11-15 16:16:27.269: INFO @log_variables: valid positive_distance nanmean: 0.679062 2019-11-15 16:16:27.269: INFO @log_variables: valid negative_distance nanmean: 1.400366 2019-11-15 16:16:27.269: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:18:00.896: INFO @metrics_hook: train matching accuracy: 0.992413487535152, N=110591, DB_SIZE=110592, N_IDS=7313 2019-11-15 16:18:01.973: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:18:02.128: INFO @evaluate_embedding: best threshold 1.0397139191627502 2019-11-15 16:18:02.199: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:18:02.199: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:18:02.379: INFO @decay_lr : LR updated to `0.00016621214` 2019-11-15 16:18:02.380: INFO @log_profile : T train: 42.744901 2019-11-15 16:18:02.380: INFO @log_profile : T valid: 1.300998 2019-11-15 16:18:02.380: INFO @log_profile : T read data: 33.513980 2019-11-15 16:18:02.380: INFO @log_profile : T hooks: 100.186449 2019-11-15 16:18:02.380: INFO @main_loop : Epoch 358 done 2019-11-15 16:18:02.380: INFO @main_loop : Training epoch 359 2019-11-15 16:19:27.233: INFO @log_variables: train loss nanmean: 0.035464 2019-11-15 16:19:27.233: INFO @log_variables: train positive_distance nanmean: 0.555154 2019-11-15 16:19:27.233: INFO @log_variables: train negative_distance nanmean: 1.419408 2019-11-15 16:19:27.233: INFO @log_variables: valid loss nanmean: 0.275934 2019-11-15 16:19:27.233: INFO @log_variables: valid positive_distance nanmean: 0.678222 2019-11-15 16:19:27.233: INFO @log_variables: valid negative_distance nanmean: 1.400410 2019-11-15 16:19:27.233: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:21:02.952: INFO @metrics_hook: train matching accuracy: 0.9931368116466227, N=110590, DB_SIZE=110592, N_IDS=7306 2019-11-15 16:21:03.936: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:21:04.112: INFO @evaluate_embedding: best threshold 1.0393160283565521 2019-11-15 16:21:04.172: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:21:04.173: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:21:04.342: INFO @decay_lr : LR updated to `0.00016538108` 2019-11-15 16:21:04.343: INFO @log_profile : T train: 42.876207 2019-11-15 16:21:04.343: INFO @log_profile : T valid: 1.299189 2019-11-15 16:21:04.343: INFO @log_profile : T read data: 35.641249 2019-11-15 16:21:04.343: INFO @log_profile : T hooks: 102.077915 2019-11-15 16:21:04.343: INFO @main_loop : Epoch 359 done 2019-11-15 16:21:04.343: INFO @main_loop : Training epoch 360 2019-11-15 16:22:27.476: INFO @log_variables: train loss nanmean: 0.034483 2019-11-15 16:22:27.477: INFO @log_variables: train positive_distance nanmean: 0.554877 2019-11-15 16:22:27.477: INFO @log_variables: train negative_distance nanmean: 1.419433 2019-11-15 16:22:27.477: INFO @log_variables: valid loss nanmean: 0.271935 2019-11-15 16:22:27.477: INFO @log_variables: valid positive_distance nanmean: 0.677179 2019-11-15 16:22:27.477: INFO @log_variables: valid negative_distance nanmean: 1.400877 2019-11-15 16:22:27.477: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:24:01.229: INFO @metrics_hook: train matching accuracy: 0.9923231336805556, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-15 16:24:02.053: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:24:02.222: INFO @evaluate_embedding: best threshold 1.0390279889106748 2019-11-15 16:24:02.291: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:24:02.292: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:24:02.471: INFO @decay_lr : LR updated to `0.00016455416` 2019-11-15 16:24:02.473: INFO @log_profile : T train: 42.746295 2019-11-15 16:24:02.473: INFO @log_profile : T valid: 1.290748 2019-11-15 16:24:02.473: INFO @log_profile : T read data: 33.892516 2019-11-15 16:24:02.473: INFO @log_profile : T hooks: 100.130950 2019-11-15 16:24:02.473: INFO @main_loop : Epoch 360 done 2019-11-15 16:24:02.473: INFO @main_loop : Training epoch 361 2019-11-15 16:25:27.381: INFO @log_variables: train loss nanmean: 0.034919 2019-11-15 16:25:27.381: INFO @log_variables: train positive_distance nanmean: 0.554972 2019-11-15 16:25:27.381: INFO @log_variables: train negative_distance nanmean: 1.419428 2019-11-15 16:25:27.381: INFO @log_variables: valid loss nanmean: 0.272934 2019-11-15 16:25:27.381: INFO @log_variables: valid positive_distance nanmean: 0.676746 2019-11-15 16:25:27.381: INFO @log_variables: valid negative_distance nanmean: 1.400439 2019-11-15 16:25:27.381: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:27:01.435: INFO @metrics_hook: train matching accuracy: 0.9920789930555556, N=110592, DB_SIZE=110592, N_IDS=7320 2019-11-15 16:27:02.340: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:27:02.477: INFO @evaluate_embedding: best threshold 1.0385927557945254 2019-11-15 16:27:02.538: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:27:02.539: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:27:02.724: INFO @decay_lr : LR updated to `0.0001637314` 2019-11-15 16:27:02.725: INFO @log_profile : T train: 42.745353 2019-11-15 16:27:02.725: INFO @log_profile : T valid: 1.298526 2019-11-15 16:27:02.725: INFO @log_profile : T read data: 35.800515 2019-11-15 16:27:02.725: INFO @log_profile : T hooks: 100.338306 2019-11-15 16:27:02.725: INFO @main_loop : Epoch 361 done 2019-11-15 16:27:02.725: INFO @main_loop : Training epoch 362 2019-11-15 16:28:26.685: INFO @log_variables: train loss nanmean: 0.035308 2019-11-15 16:28:26.685: INFO @log_variables: train positive_distance nanmean: 0.556170 2019-11-15 16:28:26.685: INFO @log_variables: train negative_distance nanmean: 1.419421 2019-11-15 16:28:26.685: INFO @log_variables: valid loss nanmean: 0.277535 2019-11-15 16:28:26.686: INFO @log_variables: valid positive_distance nanmean: 0.678253 2019-11-15 16:28:26.686: INFO @log_variables: valid negative_distance nanmean: 1.400423 2019-11-15 16:28:26.686: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:29:57.299: INFO @metrics_hook: train matching accuracy: 0.9924858261522186, N=110591, DB_SIZE=110592, N_IDS=7320 2019-11-15 16:29:58.187: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:29:58.347: INFO @evaluate_embedding: best threshold 1.0393380522727964 2019-11-15 16:29:58.414: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:29:58.414: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:29:58.605: INFO @decay_lr : LR updated to `0.00016291274` 2019-11-15 16:29:58.607: INFO @log_profile : T train: 42.811959 2019-11-15 16:29:58.607: INFO @log_profile : T valid: 1.296955 2019-11-15 16:29:58.607: INFO @log_profile : T read data: 34.831429 2019-11-15 16:29:58.607: INFO @log_profile : T hooks: 96.872369 2019-11-15 16:29:58.607: INFO @main_loop : Epoch 362 done 2019-11-15 16:29:58.607: INFO @main_loop : Training epoch 363 2019-11-15 16:31:22.542: INFO @log_variables: train loss nanmean: 0.035187 2019-11-15 16:31:22.542: INFO @log_variables: train positive_distance nanmean: 0.554942 2019-11-15 16:31:22.542: INFO @log_variables: train negative_distance nanmean: 1.419417 2019-11-15 16:31:22.542: INFO @log_variables: valid loss nanmean: 0.271555 2019-11-15 16:31:22.542: INFO @log_variables: valid positive_distance nanmean: 0.676766 2019-11-15 16:31:22.542: INFO @log_variables: valid negative_distance nanmean: 1.401044 2019-11-15 16:31:22.542: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:32:56.654: INFO @metrics_hook: train matching accuracy: 0.9918710214120371, N=110592, DB_SIZE=110592, N_IDS=7320 2019-11-15 16:32:57.555: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:32:57.712: INFO @evaluate_embedding: best threshold 1.0389050543308258 2019-11-15 16:32:57.774: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:32:57.774: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:32:57.974: INFO @decay_lr : LR updated to `0.00016209818` 2019-11-15 16:32:57.976: INFO @log_profile : T train: 42.879665 2019-11-15 16:32:57.976: INFO @log_profile : T valid: 1.301468 2019-11-15 16:32:57.976: INFO @log_profile : T read data: 34.496246 2019-11-15 16:32:57.976: INFO @log_profile : T hooks: 100.621828 2019-11-15 16:32:57.976: INFO @main_loop : Epoch 363 done 2019-11-15 16:32:57.976: INFO @main_loop : Training epoch 364 2019-11-15 16:34:24.629: INFO @log_variables: train loss nanmean: 0.034849 2019-11-15 16:34:24.629: INFO @log_variables: train positive_distance nanmean: 0.554439 2019-11-15 16:34:24.629: INFO @log_variables: train negative_distance nanmean: 1.419400 2019-11-15 16:34:24.630: INFO @log_variables: valid loss nanmean: 0.276137 2019-11-15 16:34:24.630: INFO @log_variables: valid positive_distance nanmean: 0.678393 2019-11-15 16:34:24.630: INFO @log_variables: valid negative_distance nanmean: 1.400163 2019-11-15 16:34:24.630: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:35:58.692: INFO @metrics_hook: train matching accuracy: 0.9922597679738857, N=110591, DB_SIZE=110592, N_IDS=7312 2019-11-15 16:35:59.503: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:35:59.638: INFO @evaluate_embedding: best threshold 1.039278030395508 2019-11-15 16:35:59.700: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:35:59.701: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:35:59.872: INFO @decay_lr : LR updated to `0.00016128768` 2019-11-15 16:35:59.873: INFO @log_profile : T train: 42.805808 2019-11-15 16:35:59.873: INFO @log_profile : T valid: 1.294067 2019-11-15 16:35:59.873: INFO @log_profile : T read data: 37.368844 2019-11-15 16:35:59.873: INFO @log_profile : T hooks: 100.359374 2019-11-15 16:35:59.873: INFO @main_loop : Epoch 364 done 2019-11-15 16:35:59.873: INFO @main_loop : Training epoch 365 2019-11-15 16:37:22.398: INFO @log_variables: train loss nanmean: 0.034746 2019-11-15 16:37:22.398: INFO @log_variables: train positive_distance nanmean: 0.553938 2019-11-15 16:37:22.398: INFO @log_variables: train negative_distance nanmean: 1.419400 2019-11-15 16:37:22.398: INFO @log_variables: valid loss nanmean: 0.276472 2019-11-15 16:37:22.398: INFO @log_variables: valid positive_distance nanmean: 0.679135 2019-11-15 16:37:22.398: INFO @log_variables: valid negative_distance nanmean: 1.400491 2019-11-15 16:37:22.398: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:38:55.061: INFO @metrics_hook: train matching accuracy: 0.9931911892361112, N=110592, DB_SIZE=110592, N_IDS=7305 2019-11-15 16:38:55.907: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:38:56.077: INFO @evaluate_embedding: best threshold 1.0398127138614655 2019-11-15 16:38:56.148: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:38:56.148: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:38:56.326: INFO @decay_lr : LR updated to `0.00016048124` 2019-11-15 16:38:56.329: INFO @log_profile : T train: 42.673482 2019-11-15 16:38:56.329: INFO @log_profile : T valid: 1.290245 2019-11-15 16:38:56.329: INFO @log_profile : T read data: 33.447236 2019-11-15 16:38:56.329: INFO @log_profile : T hooks: 98.977104 2019-11-15 16:38:56.329: INFO @main_loop : Epoch 365 done 2019-11-15 16:38:56.329: INFO @main_loop : Training epoch 366 2019-11-15 16:40:21.396: INFO @log_variables: train loss nanmean: 0.034674 2019-11-15 16:40:21.396: INFO @log_variables: train positive_distance nanmean: 0.555164 2019-11-15 16:40:21.397: INFO @log_variables: train negative_distance nanmean: 1.419411 2019-11-15 16:40:21.397: INFO @log_variables: valid loss nanmean: 0.276443 2019-11-15 16:40:21.397: INFO @log_variables: valid positive_distance nanmean: 0.679113 2019-11-15 16:40:21.397: INFO @log_variables: valid negative_distance nanmean: 1.400189 2019-11-15 16:40:21.397: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:41:56.439: INFO @metrics_hook: train matching accuracy: 0.99215118907677, N=110590, DB_SIZE=110592, N_IDS=7312 2019-11-15 16:41:57.519: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:42:00.165: INFO @evaluate_embedding: best threshold 1.039651244878769 2019-11-15 16:42:00.228: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:42:00.228: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:42:00.405: INFO @decay_lr : LR updated to `0.00015967884` 2019-11-15 16:42:00.406: INFO @log_profile : T train: 42.717619 2019-11-15 16:42:00.406: INFO @log_profile : T valid: 1.299281 2019-11-15 16:42:00.406: INFO @log_profile : T read data: 35.804554 2019-11-15 16:42:00.406: INFO @log_profile : T hooks: 104.186045 2019-11-15 16:42:00.406: INFO @main_loop : Epoch 366 done 2019-11-15 16:42:00.406: INFO @main_loop : Training epoch 367 2019-11-15 16:43:25.222: INFO @log_variables: train loss nanmean: 0.034674 2019-11-15 16:43:25.222: INFO @log_variables: train positive_distance nanmean: 0.554982 2019-11-15 16:43:25.222: INFO @log_variables: train negative_distance nanmean: 1.419419 2019-11-15 16:43:25.222: INFO @log_variables: valid loss nanmean: 0.274147 2019-11-15 16:43:25.222: INFO @log_variables: valid positive_distance nanmean: 0.677973 2019-11-15 16:43:25.222: INFO @log_variables: valid negative_distance nanmean: 1.400572 2019-11-15 16:43:25.222: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:44:55.988: INFO @metrics_hook: train matching accuracy: 0.9927570959662179, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 16:44:56.717: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:44:56.879: INFO @evaluate_embedding: best threshold 1.039272338151932 2019-11-15 16:44:56.947: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:44:56.947: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:44:57.121: INFO @decay_lr : LR updated to `0.00015888044` 2019-11-15 16:44:57.123: INFO @log_profile : T train: 42.648652 2019-11-15 16:44:57.123: INFO @log_profile : T valid: 1.299272 2019-11-15 16:44:57.123: INFO @log_profile : T read data: 35.571651 2019-11-15 16:44:57.123: INFO @log_profile : T hooks: 97.128699 2019-11-15 16:44:57.123: INFO @main_loop : Epoch 367 done 2019-11-15 16:44:57.123: INFO @main_loop : Training epoch 368 2019-11-15 16:46:23.693: INFO @log_variables: train loss nanmean: 0.034719 2019-11-15 16:46:23.693: INFO @log_variables: train positive_distance nanmean: 0.555061 2019-11-15 16:46:23.693: INFO @log_variables: train negative_distance nanmean: 1.419407 2019-11-15 16:46:23.693: INFO @log_variables: valid loss nanmean: 0.270379 2019-11-15 16:46:23.693: INFO @log_variables: valid positive_distance nanmean: 0.676003 2019-11-15 16:46:23.693: INFO @log_variables: valid negative_distance nanmean: 1.400739 2019-11-15 16:46:23.693: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:47:56.836: INFO @metrics_hook: train matching accuracy: 0.9920970060854861, N=110591, DB_SIZE=110592, N_IDS=7308 2019-11-15 16:47:57.690: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:47:57.844: INFO @evaluate_embedding: best threshold 1.0383711159229279 2019-11-15 16:47:57.914: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:47:57.914: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:47:58.122: INFO @decay_lr : LR updated to `0.00015808604` 2019-11-15 16:47:58.124: INFO @log_profile : T train: 42.820661 2019-11-15 16:47:58.124: INFO @log_profile : T valid: 1.301694 2019-11-15 16:47:58.124: INFO @log_profile : T read data: 37.147513 2019-11-15 16:47:58.124: INFO @log_profile : T hooks: 99.663592 2019-11-15 16:47:58.124: INFO @main_loop : Epoch 368 done 2019-11-15 16:47:58.124: INFO @main_loop : Training epoch 369 2019-11-15 16:49:22.472: INFO @log_variables: train loss nanmean: 0.035680 2019-11-15 16:49:22.473: INFO @log_variables: train positive_distance nanmean: 0.556201 2019-11-15 16:49:22.473: INFO @log_variables: train negative_distance nanmean: 1.419407 2019-11-15 16:49:22.473: INFO @log_variables: valid loss nanmean: 0.273707 2019-11-15 16:49:22.473: INFO @log_variables: valid positive_distance nanmean: 0.678018 2019-11-15 16:49:22.473: INFO @log_variables: valid negative_distance nanmean: 1.400814 2019-11-15 16:49:22.473: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:50:58.125: INFO @metrics_hook: train matching accuracy: 0.9920518663194444, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-15 16:50:58.959: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:50:59.117: INFO @evaluate_embedding: best threshold 1.03941610455513 2019-11-15 16:50:59.179: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:50:59.180: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:50:59.358: INFO @decay_lr : LR updated to `0.00015729561` 2019-11-15 16:50:59.359: INFO @log_profile : T train: 42.660585 2019-11-15 16:50:59.359: INFO @log_profile : T valid: 1.299250 2019-11-15 16:50:59.359: INFO @log_profile : T read data: 35.210063 2019-11-15 16:50:59.359: INFO @log_profile : T hooks: 101.995611 2019-11-15 16:50:59.360: INFO @main_loop : Epoch 369 done 2019-11-15 16:50:59.360: INFO @main_loop : Training epoch 370 2019-11-15 16:52:23.821: INFO @log_variables: train loss nanmean: 0.035874 2019-11-15 16:52:23.821: INFO @log_variables: train positive_distance nanmean: 0.555305 2019-11-15 16:52:23.822: INFO @log_variables: train negative_distance nanmean: 1.419424 2019-11-15 16:52:23.822: INFO @log_variables: valid loss nanmean: 0.273386 2019-11-15 16:52:23.822: INFO @log_variables: valid positive_distance nanmean: 0.676171 2019-11-15 16:52:23.822: INFO @log_variables: valid negative_distance nanmean: 1.400510 2019-11-15 16:52:23.822: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:53:57.938: INFO @metrics_hook: train matching accuracy: 0.9919162326388888, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-15 16:53:58.624: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:53:58.789: INFO @evaluate_embedding: best threshold 1.0383405685424807 2019-11-15 16:53:58.853: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:53:58.853: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:53:59.017: INFO @decay_lr : LR updated to `0.00015650914` 2019-11-15 16:53:59.018: INFO @log_profile : T train: 42.670751 2019-11-15 16:53:59.018: INFO @log_profile : T valid: 1.294526 2019-11-15 16:53:59.018: INFO @log_profile : T read data: 35.599784 2019-11-15 16:53:59.018: INFO @log_profile : T hooks: 100.026068 2019-11-15 16:53:59.018: INFO @main_loop : Epoch 370 done 2019-11-15 16:53:59.018: INFO @main_loop : Training epoch 371 2019-11-15 16:55:23.322: INFO @log_variables: train loss nanmean: 0.034339 2019-11-15 16:55:23.323: INFO @log_variables: train positive_distance nanmean: 0.554156 2019-11-15 16:55:23.323: INFO @log_variables: train negative_distance nanmean: 1.419407 2019-11-15 16:55:23.323: INFO @log_variables: valid loss nanmean: 0.272007 2019-11-15 16:55:23.323: INFO @log_variables: valid positive_distance nanmean: 0.677682 2019-11-15 16:55:23.323: INFO @log_variables: valid negative_distance nanmean: 1.400811 2019-11-15 16:55:23.323: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:56:58.164: INFO @metrics_hook: train matching accuracy: 0.9919884257166109, N=110590, DB_SIZE=110592, N_IDS=7320 2019-11-15 16:56:59.039: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:56:59.195: INFO @evaluate_embedding: best threshold 1.0392467975616455 2019-11-15 16:56:59.267: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:56:59.267: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:56:59.454: INFO @decay_lr : LR updated to `0.0001557266` 2019-11-15 16:56:59.455: INFO @log_profile : T train: 42.787142 2019-11-15 16:56:59.455: INFO @log_profile : T valid: 1.301358 2019-11-15 16:56:59.455: INFO @log_profile : T read data: 35.019374 2019-11-15 16:56:59.455: INFO @log_profile : T hooks: 101.260402 2019-11-15 16:56:59.455: INFO @main_loop : Epoch 371 done 2019-11-15 16:56:59.455: INFO @main_loop : Training epoch 372 2019-11-15 16:58:23.154: INFO @log_variables: train loss nanmean: 0.034835 2019-11-15 16:58:23.154: INFO @log_variables: train positive_distance nanmean: 0.554651 2019-11-15 16:58:23.154: INFO @log_variables: train negative_distance nanmean: 1.419417 2019-11-15 16:58:23.155: INFO @log_variables: valid loss nanmean: 0.272350 2019-11-15 16:58:23.155: INFO @log_variables: valid positive_distance nanmean: 0.678161 2019-11-15 16:58:23.155: INFO @log_variables: valid negative_distance nanmean: 1.400903 2019-11-15 16:58:23.155: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 16:59:57.442: INFO @metrics_hook: train matching accuracy: 0.9933720341435185, N=110592, DB_SIZE=110592, N_IDS=7296 2019-11-15 16:59:58.219: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 16:59:58.388: INFO @evaluate_embedding: best threshold 1.039531737565994 2019-11-15 16:59:58.452: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 16:59:58.452: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 16:59:58.627: INFO @decay_lr : LR updated to `0.00015494796` 2019-11-15 16:59:58.628: INFO @log_profile : T train: 42.740583 2019-11-15 16:59:58.628: INFO @log_profile : T valid: 1.308826 2019-11-15 16:59:58.628: INFO @log_profile : T read data: 34.957382 2019-11-15 16:59:58.629: INFO @log_profile : T hooks: 100.099054 2019-11-15 16:59:58.629: INFO @main_loop : Epoch 372 done 2019-11-15 16:59:58.629: INFO @main_loop : Training epoch 373 2019-11-15 17:01:23.217: INFO @log_variables: train loss nanmean: 0.033742 2019-11-15 17:01:23.217: INFO @log_variables: train positive_distance nanmean: 0.554541 2019-11-15 17:01:23.218: INFO @log_variables: train negative_distance nanmean: 1.419447 2019-11-15 17:01:23.218: INFO @log_variables: valid loss nanmean: 0.275388 2019-11-15 17:01:23.218: INFO @log_variables: valid positive_distance nanmean: 0.677715 2019-11-15 17:01:23.218: INFO @log_variables: valid negative_distance nanmean: 1.400801 2019-11-15 17:01:23.218: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:02:58.120: INFO @metrics_hook: train matching accuracy: 0.9926576303677515, N=110591, DB_SIZE=110592, N_IDS=7318 2019-11-15 17:02:59.040: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:02:59.189: INFO @evaluate_embedding: best threshold 1.03925821185112 2019-11-15 17:02:59.252: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:02:59.252: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:02:59.427: INFO @decay_lr : LR updated to `0.00015417322` 2019-11-15 17:02:59.428: INFO @log_profile : T train: 42.834740 2019-11-15 17:02:59.428: INFO @log_profile : T valid: 1.301754 2019-11-15 17:02:59.428: INFO @log_profile : T read data: 35.377972 2019-11-15 17:02:59.428: INFO @log_profile : T hooks: 101.217184 2019-11-15 17:02:59.428: INFO @main_loop : Epoch 373 done 2019-11-15 17:02:59.428: INFO @main_loop : Training epoch 374 2019-11-15 17:04:22.927: INFO @log_variables: train loss nanmean: 0.034311 2019-11-15 17:04:22.928: INFO @log_variables: train positive_distance nanmean: 0.554165 2019-11-15 17:04:22.928: INFO @log_variables: train negative_distance nanmean: 1.419431 2019-11-15 17:04:22.928: INFO @log_variables: valid loss nanmean: 0.270891 2019-11-15 17:04:22.928: INFO @log_variables: valid positive_distance nanmean: 0.676057 2019-11-15 17:04:22.928: INFO @log_variables: valid negative_distance nanmean: 1.400577 2019-11-15 17:04:22.928: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:05:56.077: INFO @metrics_hook: train matching accuracy: 0.9925672743055556, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 17:05:56.898: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:05:57.045: INFO @evaluate_embedding: best threshold 1.0383170545101164 2019-11-15 17:05:57.109: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:05:57.109: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:05:57.291: INFO @decay_lr : LR updated to `0.00015340235` 2019-11-15 17:05:57.292: INFO @log_profile : T train: 42.800902 2019-11-15 17:05:57.292: INFO @log_profile : T valid: 1.300603 2019-11-15 17:05:57.292: INFO @log_profile : T read data: 34.350307 2019-11-15 17:05:57.292: INFO @log_profile : T hooks: 99.344798 2019-11-15 17:05:57.293: INFO @main_loop : Epoch 374 done 2019-11-15 17:05:57.293: INFO @main_loop : Training epoch 375 2019-11-15 17:07:23.343: INFO @log_variables: train loss nanmean: 0.034118 2019-11-15 17:07:23.343: INFO @log_variables: train positive_distance nanmean: 0.554451 2019-11-15 17:07:23.343: INFO @log_variables: train negative_distance nanmean: 1.419433 2019-11-15 17:07:23.343: INFO @log_variables: valid loss nanmean: 0.274521 2019-11-15 17:07:23.343: INFO @log_variables: valid positive_distance nanmean: 0.677549 2019-11-15 17:07:23.343: INFO @log_variables: valid negative_distance nanmean: 1.400795 2019-11-15 17:07:23.344: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:08:57.673: INFO @metrics_hook: train matching accuracy: 0.9924225983796297, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-15 17:08:58.642: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:08:58.804: INFO @evaluate_embedding: best threshold 1.0391716957092285 2019-11-15 17:08:58.875: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:08:58.875: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:08:59.053: INFO @decay_lr : LR updated to `0.00015263533` 2019-11-15 17:08:59.054: INFO @log_profile : T train: 42.695264 2019-11-15 17:08:59.054: INFO @log_profile : T valid: 1.296459 2019-11-15 17:08:59.055: INFO @log_profile : T read data: 36.951685 2019-11-15 17:08:59.055: INFO @log_profile : T hooks: 100.750920 2019-11-15 17:08:59.055: INFO @main_loop : Epoch 375 done 2019-11-15 17:08:59.055: INFO @main_loop : Training epoch 376 2019-11-15 17:10:23.285: INFO @log_variables: train loss nanmean: 0.034475 2019-11-15 17:10:23.285: INFO @log_variables: train positive_distance nanmean: 0.554673 2019-11-15 17:10:23.285: INFO @log_variables: train negative_distance nanmean: 1.419434 2019-11-15 17:10:23.285: INFO @log_variables: valid loss nanmean: 0.273195 2019-11-15 17:10:23.285: INFO @log_variables: valid positive_distance nanmean: 0.677429 2019-11-15 17:10:23.285: INFO @log_variables: valid negative_distance nanmean: 1.400837 2019-11-15 17:10:23.285: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:11:59.458: INFO @metrics_hook: train matching accuracy: 0.9931188512731481, N=110592, DB_SIZE=110592, N_IDS=7320 2019-11-15 17:12:00.496: INFO @metrics_hook: valid matching accuracy: 0.98816252532793, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:12:00.671: INFO @evaluate_embedding: best threshold 1.039132595062256 2019-11-15 17:12:00.737: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:12:00.737: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:12:00.919: INFO @decay_lr : LR updated to `0.00015187215` 2019-11-15 17:12:00.920: INFO @log_profile : T train: 42.756195 2019-11-15 17:12:00.920: INFO @log_profile : T valid: 1.302072 2019-11-15 17:12:00.920: INFO @log_profile : T read data: 35.189539 2019-11-15 17:12:00.920: INFO @log_profile : T hooks: 102.549516 2019-11-15 17:12:00.920: INFO @main_loop : Epoch 376 done 2019-11-15 17:12:00.921: INFO @main_loop : Training epoch 377 2019-11-15 17:13:26.830: INFO @log_variables: train loss nanmean: 0.034907 2019-11-15 17:13:26.830: INFO @log_variables: train positive_distance nanmean: 0.554911 2019-11-15 17:13:26.830: INFO @log_variables: train negative_distance nanmean: 1.419431 2019-11-15 17:13:26.830: INFO @log_variables: valid loss nanmean: 0.273516 2019-11-15 17:13:26.830: INFO @log_variables: valid positive_distance nanmean: 0.678171 2019-11-15 17:13:26.831: INFO @log_variables: valid negative_distance nanmean: 1.400897 2019-11-15 17:13:26.831: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:15:01.615: INFO @metrics_hook: train matching accuracy: 0.9928384769104177, N=110591, DB_SIZE=110592, N_IDS=7302 2019-11-15 17:15:02.446: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:15:02.611: INFO @evaluate_embedding: best threshold 1.0395340323448181 2019-11-15 17:15:02.684: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:15:02.684: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:15:02.866: INFO @decay_lr : LR updated to `0.00015111279` 2019-11-15 17:15:02.868: INFO @log_profile : T train: 42.682068 2019-11-15 17:15:02.868: INFO @log_profile : T valid: 1.296478 2019-11-15 17:15:02.868: INFO @log_profile : T read data: 36.814352 2019-11-15 17:15:02.868: INFO @log_profile : T hooks: 101.086720 2019-11-15 17:15:02.868: INFO @main_loop : Epoch 377 done 2019-11-15 17:15:02.868: INFO @main_loop : Training epoch 378 2019-11-15 17:16:27.861: INFO @log_variables: train loss nanmean: 0.034424 2019-11-15 17:16:27.861: INFO @log_variables: train positive_distance nanmean: 0.554743 2019-11-15 17:16:27.861: INFO @log_variables: train negative_distance nanmean: 1.419426 2019-11-15 17:16:27.861: INFO @log_variables: valid loss nanmean: 0.272310 2019-11-15 17:16:27.861: INFO @log_variables: valid positive_distance nanmean: 0.676435 2019-11-15 17:16:27.861: INFO @log_variables: valid negative_distance nanmean: 1.400422 2019-11-15 17:16:27.861: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:18:00.819: INFO @metrics_hook: train matching accuracy: 0.9922235986653525, N=110591, DB_SIZE=110592, N_IDS=7305 2019-11-15 17:18:01.800: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:18:01.961: INFO @evaluate_embedding: best threshold 1.0384283661842348 2019-11-15 17:18:02.024: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:18:02.024: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:18:02.208: INFO @decay_lr : LR updated to `0.00015035723` 2019-11-15 17:18:02.210: INFO @log_profile : T train: 42.947340 2019-11-15 17:18:02.210: INFO @log_profile : T valid: 1.296608 2019-11-15 17:18:02.210: INFO @log_profile : T read data: 35.651117 2019-11-15 17:18:02.210: INFO @log_profile : T hooks: 99.378749 2019-11-15 17:18:02.210: INFO @main_loop : Epoch 378 done 2019-11-15 17:18:02.210: INFO @main_loop : Training epoch 379 2019-11-15 17:19:28.419: INFO @log_variables: train loss nanmean: 0.034040 2019-11-15 17:19:28.420: INFO @log_variables: train positive_distance nanmean: 0.554755 2019-11-15 17:19:28.420: INFO @log_variables: train negative_distance nanmean: 1.419422 2019-11-15 17:19:28.420: INFO @log_variables: valid loss nanmean: 0.274685 2019-11-15 17:19:28.420: INFO @log_variables: valid positive_distance nanmean: 0.677651 2019-11-15 17:19:28.420: INFO @log_variables: valid negative_distance nanmean: 1.400571 2019-11-15 17:19:28.420: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:21:00.605: INFO @metrics_hook: train matching accuracy: 0.9928836885460842, N=110591, DB_SIZE=110592, N_IDS=7304 2019-11-15 17:21:01.476: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:21:01.641: INFO @evaluate_embedding: best threshold 1.03911092877388 2019-11-15 17:21:01.707: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:21:01.707: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:21:01.892: INFO @decay_lr : LR updated to `0.00014960545` 2019-11-15 17:21:01.894: INFO @log_profile : T train: 42.835485 2019-11-15 17:21:01.894: INFO @log_profile : T valid: 1.305340 2019-11-15 17:21:01.894: INFO @log_profile : T read data: 37.186487 2019-11-15 17:21:01.894: INFO @log_profile : T hooks: 98.288412 2019-11-15 17:21:01.894: INFO @main_loop : Epoch 379 done 2019-11-15 17:21:01.894: INFO @main_loop : Training epoch 380 2019-11-15 17:22:25.795: INFO @log_variables: train loss nanmean: 0.034333 2019-11-15 17:22:25.795: INFO @log_variables: train positive_distance nanmean: 0.554267 2019-11-15 17:22:25.795: INFO @log_variables: train negative_distance nanmean: 1.419419 2019-11-15 17:22:25.796: INFO @log_variables: valid loss nanmean: 0.271754 2019-11-15 17:22:25.796: INFO @log_variables: valid positive_distance nanmean: 0.676983 2019-11-15 17:22:25.796: INFO @log_variables: valid negative_distance nanmean: 1.400794 2019-11-15 17:22:25.796: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:24:00.265: INFO @metrics_hook: train matching accuracy: 0.9918347785986201, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 17:24:01.281: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:24:01.436: INFO @evaluate_embedding: best threshold 1.0388885140419006 2019-11-15 17:24:01.504: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:24:01.504: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:24:01.682: INFO @decay_lr : LR updated to `0.00014885742` 2019-11-15 17:24:01.684: INFO @log_profile : T train: 42.806975 2019-11-15 17:24:01.684: INFO @log_profile : T valid: 1.299098 2019-11-15 17:24:01.684: INFO @log_profile : T read data: 34.581158 2019-11-15 17:24:01.684: INFO @log_profile : T hooks: 101.035309 2019-11-15 17:24:01.684: INFO @main_loop : Epoch 380 done 2019-11-15 17:24:01.684: INFO @main_loop : Training epoch 381 2019-11-15 17:25:27.314: INFO @log_variables: train loss nanmean: 0.034919 2019-11-15 17:25:27.314: INFO @log_variables: train positive_distance nanmean: 0.554658 2019-11-15 17:25:27.314: INFO @log_variables: train negative_distance nanmean: 1.419421 2019-11-15 17:25:27.314: INFO @log_variables: valid loss nanmean: 0.273829 2019-11-15 17:25:27.315: INFO @log_variables: valid positive_distance nanmean: 0.678314 2019-11-15 17:25:27.315: INFO @log_variables: valid negative_distance nanmean: 1.400465 2019-11-15 17:25:27.315: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:27:00.994: INFO @metrics_hook: train matching accuracy: 0.991943359375, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 17:27:01.618: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:27:01.765: INFO @evaluate_embedding: best threshold 1.039389729499817 2019-11-15 17:27:01.827: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:27:01.827: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:27:01.991: INFO @decay_lr : LR updated to `0.00014811313` 2019-11-15 17:27:01.993: INFO @log_profile : T train: 42.799148 2019-11-15 17:27:01.993: INFO @log_profile : T valid: 1.314343 2019-11-15 17:27:01.993: INFO @log_profile : T read data: 36.309894 2019-11-15 17:27:01.993: INFO @log_profile : T hooks: 99.817784 2019-11-15 17:27:01.993: INFO @main_loop : Epoch 381 done 2019-11-15 17:27:01.993: INFO @main_loop : Training epoch 382 2019-11-15 17:28:25.971: INFO @log_variables: train loss nanmean: 0.034644 2019-11-15 17:28:25.971: INFO @log_variables: train positive_distance nanmean: 0.554586 2019-11-15 17:28:25.971: INFO @log_variables: train negative_distance nanmean: 1.419406 2019-11-15 17:28:25.971: INFO @log_variables: valid loss nanmean: 0.272901 2019-11-15 17:28:25.971: INFO @log_variables: valid positive_distance nanmean: 0.676995 2019-11-15 17:28:25.972: INFO @log_variables: valid negative_distance nanmean: 1.400698 2019-11-15 17:28:25.972: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:30:00.084: INFO @metrics_hook: train matching accuracy: 0.9924949363425926, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-15 17:30:00.926: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:30:01.090: INFO @evaluate_embedding: best threshold 1.0388461947441099 2019-11-15 17:30:01.158: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:30:01.158: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:30:01.343: INFO @decay_lr : LR updated to `0.00014737257` 2019-11-15 17:30:01.344: INFO @log_profile : T train: 43.640570 2019-11-15 17:30:01.344: INFO @log_profile : T valid: 1.299450 2019-11-15 17:30:01.344: INFO @log_profile : T read data: 34.012357 2019-11-15 17:30:01.344: INFO @log_profile : T hooks: 100.328513 2019-11-15 17:30:01.344: INFO @main_loop : Epoch 382 done 2019-11-15 17:30:01.344: INFO @main_loop : Training epoch 383 2019-11-15 17:31:27.614: INFO @log_variables: train loss nanmean: 0.034298 2019-11-15 17:31:27.614: INFO @log_variables: train positive_distance nanmean: 0.553753 2019-11-15 17:31:27.614: INFO @log_variables: train negative_distance nanmean: 1.419434 2019-11-15 17:31:27.614: INFO @log_variables: valid loss nanmean: 0.272068 2019-11-15 17:31:27.614: INFO @log_variables: valid positive_distance nanmean: 0.676131 2019-11-15 17:31:27.615: INFO @log_variables: valid negative_distance nanmean: 1.400644 2019-11-15 17:31:27.615: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:33:00.791: INFO @metrics_hook: train matching accuracy: 0.9926667390046297, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 17:33:01.637: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:33:01.797: INFO @evaluate_embedding: best threshold 1.0383873283863068 2019-11-15 17:33:01.868: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:33:01.868: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:33:02.054: INFO @decay_lr : LR updated to `0.0001466357` 2019-11-15 17:33:02.055: INFO @log_profile : T train: 42.911019 2019-11-15 17:33:02.055: INFO @log_profile : T valid: 1.312228 2019-11-15 17:33:02.055: INFO @log_profile : T read data: 36.822175 2019-11-15 17:33:02.055: INFO @log_profile : T hooks: 99.597469 2019-11-15 17:33:02.056: INFO @main_loop : Epoch 383 done 2019-11-15 17:33:02.056: INFO @main_loop : Training epoch 384 2019-11-15 17:34:24.692: INFO @log_variables: train loss nanmean: 0.033886 2019-11-15 17:34:24.692: INFO @log_variables: train positive_distance nanmean: 0.553293 2019-11-15 17:34:24.692: INFO @log_variables: train negative_distance nanmean: 1.419423 2019-11-15 17:34:24.692: INFO @log_variables: valid loss nanmean: 0.271530 2019-11-15 17:34:24.692: INFO @log_variables: valid positive_distance nanmean: 0.677501 2019-11-15 17:34:24.692: INFO @log_variables: valid negative_distance nanmean: 1.400750 2019-11-15 17:34:24.692: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:36:01.689: INFO @metrics_hook: train matching accuracy: 0.9921422887731481, N=110592, DB_SIZE=110592, N_IDS=7317 2019-11-15 17:36:02.622: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:36:02.777: INFO @evaluate_embedding: best threshold 1.0391255617141724 2019-11-15 17:36:02.842: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:36:02.842: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:36:03.013: INFO @decay_lr : LR updated to `0.00014590252` 2019-11-15 17:36:03.015: INFO @log_profile : T train: 42.708162 2019-11-15 17:36:03.015: INFO @log_profile : T valid: 1.301559 2019-11-15 17:36:03.015: INFO @log_profile : T read data: 33.681509 2019-11-15 17:36:03.015: INFO @log_profile : T hooks: 103.200299 2019-11-15 17:36:03.015: INFO @main_loop : Epoch 384 done 2019-11-15 17:36:03.015: INFO @main_loop : Training epoch 385 2019-11-15 17:37:28.163: INFO @log_variables: train loss nanmean: 0.034825 2019-11-15 17:37:28.164: INFO @log_variables: train positive_distance nanmean: 0.555419 2019-11-15 17:37:28.164: INFO @log_variables: train negative_distance nanmean: 1.419421 2019-11-15 17:37:28.164: INFO @log_variables: valid loss nanmean: 0.273083 2019-11-15 17:37:28.164: INFO @log_variables: valid positive_distance nanmean: 0.677008 2019-11-15 17:37:28.164: INFO @log_variables: valid negative_distance nanmean: 1.400954 2019-11-15 17:37:28.164: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:39:02.832: INFO @metrics_hook: train matching accuracy: 0.9920789214312196, N=110591, DB_SIZE=110592, N_IDS=7302 2019-11-15 17:39:03.716: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:39:03.867: INFO @evaluate_embedding: best threshold 1.0389811098575592 2019-11-15 17:39:03.934: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:39:03.934: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:39:04.108: INFO @decay_lr : LR updated to `0.000145173` 2019-11-15 17:39:04.109: INFO @log_profile : T train: 42.743407 2019-11-15 17:39:04.109: INFO @log_profile : T valid: 1.308193 2019-11-15 17:39:04.110: INFO @log_profile : T read data: 36.021567 2019-11-15 17:39:04.110: INFO @log_profile : T hooks: 100.950582 2019-11-15 17:39:04.110: INFO @main_loop : Epoch 385 done 2019-11-15 17:39:04.110: INFO @main_loop : Training epoch 386 2019-11-15 17:40:30.358: INFO @log_variables: train loss nanmean: 0.034052 2019-11-15 17:40:30.358: INFO @log_variables: train positive_distance nanmean: 0.554392 2019-11-15 17:40:30.359: INFO @log_variables: train negative_distance nanmean: 1.419432 2019-11-15 17:40:30.359: INFO @log_variables: valid loss nanmean: 0.271720 2019-11-15 17:40:30.359: INFO @log_variables: valid positive_distance nanmean: 0.679000 2019-11-15 17:40:30.359: INFO @log_variables: valid negative_distance nanmean: 1.400582 2019-11-15 17:40:30.359: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:42:01.903: INFO @metrics_hook: train matching accuracy: 0.9924045138888888, N=110592, DB_SIZE=110592, N_IDS=7302 2019-11-15 17:42:02.647: INFO @metrics_hook: valid matching accuracy: 0.9878425935800362, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:42:02.824: INFO @evaluate_embedding: best threshold 1.0397908687591553 2019-11-15 17:42:02.890: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:42:02.891: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:42:03.078: INFO @decay_lr : LR updated to `0.00014444714` 2019-11-15 17:42:03.080: INFO @log_profile : T train: 42.744403 2019-11-15 17:42:03.080: INFO @log_profile : T valid: 1.305105 2019-11-15 17:42:03.080: INFO @log_profile : T read data: 37.203934 2019-11-15 17:42:03.080: INFO @log_profile : T hooks: 97.648224 2019-11-15 17:42:03.080: INFO @main_loop : Epoch 386 done 2019-11-15 17:42:03.080: INFO @main_loop : Training epoch 387 2019-11-15 17:43:25.944: INFO @log_variables: train loss nanmean: 0.032708 2019-11-15 17:43:25.944: INFO @log_variables: train positive_distance nanmean: 0.553688 2019-11-15 17:43:25.944: INFO @log_variables: train negative_distance nanmean: 1.419424 2019-11-15 17:43:25.944: INFO @log_variables: valid loss nanmean: 0.273733 2019-11-15 17:43:25.944: INFO @log_variables: valid positive_distance nanmean: 0.677831 2019-11-15 17:43:25.945: INFO @log_variables: valid negative_distance nanmean: 1.400365 2019-11-15 17:43:25.945: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:45:00.419: INFO @metrics_hook: train matching accuracy: 0.9923501912452188, N=110591, DB_SIZE=110592, N_IDS=7313 2019-11-15 17:45:01.356: INFO @metrics_hook: valid matching accuracy: 0.9880558814119654, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:45:01.507: INFO @evaluate_embedding: best threshold 1.0390977561473844 2019-11-15 17:45:01.572: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:45:01.572: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:45:01.745: INFO @decay_lr : LR updated to `0.0001437249` 2019-11-15 17:45:01.746: INFO @log_profile : T train: 42.676720 2019-11-15 17:45:01.746: INFO @log_profile : T valid: 1.292356 2019-11-15 17:45:01.746: INFO @log_profile : T read data: 33.818015 2019-11-15 17:45:01.746: INFO @log_profile : T hooks: 100.810986 2019-11-15 17:45:01.746: INFO @main_loop : Epoch 387 done 2019-11-15 17:45:01.746: INFO @main_loop : Training epoch 388 2019-11-15 17:46:27.234: INFO @log_variables: train loss nanmean: 0.033860 2019-11-15 17:46:27.234: INFO @log_variables: train positive_distance nanmean: 0.554589 2019-11-15 17:46:27.234: INFO @log_variables: train negative_distance nanmean: 1.419427 2019-11-15 17:46:27.235: INFO @log_variables: valid loss nanmean: 0.273368 2019-11-15 17:46:27.235: INFO @log_variables: valid positive_distance nanmean: 0.679332 2019-11-15 17:46:27.235: INFO @log_variables: valid negative_distance nanmean: 1.400732 2019-11-15 17:46:27.235: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:48:01.546: INFO @metrics_hook: train matching accuracy: 0.9923773871527778, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 17:48:02.417: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:48:02.583: INFO @evaluate_embedding: best threshold 1.040031999349594 2019-11-15 17:48:02.652: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:48:02.652: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:48:02.829: INFO @decay_lr : LR updated to `0.00014300627` 2019-11-15 17:48:02.830: INFO @log_profile : T train: 42.623984 2019-11-15 17:48:02.830: INFO @log_profile : T valid: 1.299817 2019-11-15 17:48:02.830: INFO @log_profile : T read data: 36.456045 2019-11-15 17:48:02.831: INFO @log_profile : T hooks: 100.636803 2019-11-15 17:48:02.831: INFO @main_loop : Epoch 388 done 2019-11-15 17:48:02.831: INFO @main_loop : Training epoch 389 2019-11-15 17:49:25.987: INFO @log_variables: train loss nanmean: 0.033328 2019-11-15 17:49:25.987: INFO @log_variables: train positive_distance nanmean: 0.553714 2019-11-15 17:49:25.987: INFO @log_variables: train negative_distance nanmean: 1.419438 2019-11-15 17:49:25.987: INFO @log_variables: valid loss nanmean: 0.271601 2019-11-15 17:49:25.987: INFO @log_variables: valid positive_distance nanmean: 0.679197 2019-11-15 17:49:25.987: INFO @log_variables: valid negative_distance nanmean: 1.400552 2019-11-15 17:49:25.987: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:51:01.570: INFO @metrics_hook: train matching accuracy: 0.9924135561342593, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 17:51:02.518: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:51:02.672: INFO @evaluate_embedding: best threshold 1.0398744642734528 2019-11-15 17:51:02.737: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:51:02.737: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:51:02.908: INFO @decay_lr : LR updated to `0.00014229123` 2019-11-15 17:51:02.910: INFO @log_profile : T train: 42.766609 2019-11-15 17:51:02.910: INFO @log_profile : T valid: 1.296514 2019-11-15 17:51:02.910: INFO @log_profile : T read data: 33.939931 2019-11-15 17:51:02.910: INFO @log_profile : T hooks: 102.008347 2019-11-15 17:51:02.910: INFO @main_loop : Epoch 389 done 2019-11-15 17:51:02.910: INFO @main_loop : Training epoch 390 2019-11-15 17:52:30.213: INFO @log_variables: train loss nanmean: 0.033778 2019-11-15 17:52:30.213: INFO @log_variables: train positive_distance nanmean: 0.553332 2019-11-15 17:52:30.213: INFO @log_variables: train negative_distance nanmean: 1.419429 2019-11-15 17:52:30.213: INFO @log_variables: valid loss nanmean: 0.272574 2019-11-15 17:52:30.213: INFO @log_variables: valid positive_distance nanmean: 0.677508 2019-11-15 17:52:30.214: INFO @log_variables: valid negative_distance nanmean: 1.400354 2019-11-15 17:52:30.214: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:54:04.450: INFO @metrics_hook: train matching accuracy: 0.9929379425088841, N=110591, DB_SIZE=110592, N_IDS=7314 2019-11-15 17:54:05.398: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:54:05.560: INFO @evaluate_embedding: best threshold 1.0389306247234344 2019-11-15 17:54:05.623: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:54:05.623: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:54:05.815: INFO @decay_lr : LR updated to `0.00014157977` 2019-11-15 17:54:05.816: INFO @log_profile : T train: 42.763652 2019-11-15 17:54:05.816: INFO @log_profile : T valid: 1.303445 2019-11-15 17:54:05.816: INFO @log_profile : T read data: 38.206818 2019-11-15 17:54:05.817: INFO @log_profile : T hooks: 100.563791 2019-11-15 17:54:05.817: INFO @main_loop : Epoch 390 done 2019-11-15 17:54:05.817: INFO @main_loop : Training epoch 391 2019-11-15 17:55:29.010: INFO @log_variables: train loss nanmean: 0.034090 2019-11-15 17:55:29.010: INFO @log_variables: train positive_distance nanmean: 0.553881 2019-11-15 17:55:29.010: INFO @log_variables: train negative_distance nanmean: 1.419411 2019-11-15 17:55:29.010: INFO @log_variables: valid loss nanmean: 0.274367 2019-11-15 17:55:29.010: INFO @log_variables: valid positive_distance nanmean: 0.676433 2019-11-15 17:55:29.011: INFO @log_variables: valid negative_distance nanmean: 1.400123 2019-11-15 17:55:29.011: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 17:57:02.344: INFO @metrics_hook: train matching accuracy: 0.9917625144675926, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 17:57:03.208: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 17:57:03.371: INFO @evaluate_embedding: best threshold 1.0382777154445648 2019-11-15 17:57:03.440: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 17:57:03.440: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 17:57:03.619: INFO @decay_lr : LR updated to `0.00014087188` 2019-11-15 17:57:03.620: INFO @log_profile : T train: 42.720235 2019-11-15 17:57:03.620: INFO @log_profile : T valid: 1.294505 2019-11-15 17:57:03.621: INFO @log_profile : T read data: 34.184910 2019-11-15 17:57:03.621: INFO @log_profile : T hooks: 99.535471 2019-11-15 17:57:03.621: INFO @main_loop : Epoch 391 done 2019-11-15 17:57:03.621: INFO @main_loop : Training epoch 392 2019-11-15 17:58:28.486: INFO @log_variables: train loss nanmean: 0.033594 2019-11-15 17:58:28.486: INFO @log_variables: train positive_distance nanmean: 0.554338 2019-11-15 17:58:28.486: INFO @log_variables: train negative_distance nanmean: 1.419424 2019-11-15 17:58:28.486: INFO @log_variables: valid loss nanmean: 0.272597 2019-11-15 17:58:28.486: INFO @log_variables: valid positive_distance nanmean: 0.676703 2019-11-15 17:58:28.486: INFO @log_variables: valid negative_distance nanmean: 1.400444 2019-11-15 17:58:28.487: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:00:03.733: INFO @metrics_hook: train matching accuracy: 0.9927662037037037, N=110592, DB_SIZE=110592, N_IDS=7320 2019-11-15 18:00:04.586: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:00:04.763: INFO @evaluate_embedding: best threshold 1.0385734736919403 2019-11-15 18:00:04.824: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:00:04.824: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:00:05.005: INFO @decay_lr : LR updated to `0.00014016753` 2019-11-15 18:00:05.007: INFO @log_profile : T train: 44.272759 2019-11-15 18:00:05.007: INFO @log_profile : T valid: 1.405854 2019-11-15 18:00:05.007: INFO @log_profile : T read data: 34.155623 2019-11-15 18:00:05.007: INFO @log_profile : T hooks: 101.483294 2019-11-15 18:00:05.007: INFO @main_loop : Epoch 392 done 2019-11-15 18:00:05.007: INFO @main_loop : Training epoch 393 2019-11-15 18:01:28.261: INFO @log_variables: train loss nanmean: 0.033967 2019-11-15 18:01:28.261: INFO @log_variables: train positive_distance nanmean: 0.554293 2019-11-15 18:01:28.261: INFO @log_variables: train negative_distance nanmean: 1.419424 2019-11-15 18:01:28.261: INFO @log_variables: valid loss nanmean: 0.274823 2019-11-15 18:01:28.261: INFO @log_variables: valid positive_distance nanmean: 0.679599 2019-11-15 18:01:28.261: INFO @log_variables: valid negative_distance nanmean: 1.400528 2019-11-15 18:01:28.261: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:03:00.426: INFO @metrics_hook: train matching accuracy: 0.9924677414979519, N=110591, DB_SIZE=110592, N_IDS=7310 2019-11-15 18:03:01.263: INFO @metrics_hook: valid matching accuracy: 0.9878425935800362, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:03:01.386: INFO @evaluate_embedding: best threshold 1.0400633811950686 2019-11-15 18:03:01.447: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:03:01.448: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:03:01.613: INFO @decay_lr : LR updated to `0.00013946669` 2019-11-15 18:03:01.615: INFO @log_profile : T train: 42.864896 2019-11-15 18:03:01.615: INFO @log_profile : T valid: 1.327769 2019-11-15 18:03:01.615: INFO @log_profile : T read data: 33.936230 2019-11-15 18:03:01.615: INFO @log_profile : T hooks: 98.409592 2019-11-15 18:03:01.615: INFO @main_loop : Epoch 393 done 2019-11-15 18:03:01.615: INFO @main_loop : Training epoch 394 2019-11-15 18:04:25.847: INFO @log_variables: train loss nanmean: 0.033307 2019-11-15 18:04:25.847: INFO @log_variables: train positive_distance nanmean: 0.554096 2019-11-15 18:04:25.847: INFO @log_variables: train negative_distance nanmean: 1.419445 2019-11-15 18:04:25.847: INFO @log_variables: valid loss nanmean: 0.275434 2019-11-15 18:04:25.847: INFO @log_variables: valid positive_distance nanmean: 0.677573 2019-11-15 18:04:25.847: INFO @log_variables: valid negative_distance nanmean: 1.400280 2019-11-15 18:04:25.847: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:05:59.715: INFO @metrics_hook: train matching accuracy: 0.9926576967592593, N=110592, DB_SIZE=110592, N_IDS=7317 2019-11-15 18:06:00.470: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:06:00.632: INFO @evaluate_embedding: best threshold 1.038926661014557 2019-11-15 18:06:00.696: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:06:00.696: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:06:00.879: INFO @decay_lr : LR updated to `0.00013876936` 2019-11-15 18:06:00.880: INFO @log_profile : T train: 42.756551 2019-11-15 18:06:00.880: INFO @log_profile : T valid: 1.299590 2019-11-15 18:06:00.880: INFO @log_profile : T read data: 35.121896 2019-11-15 18:06:00.880: INFO @log_profile : T hooks: 100.018569 2019-11-15 18:06:00.880: INFO @main_loop : Epoch 394 done 2019-11-15 18:06:00.880: INFO @main_loop : Training epoch 395 2019-11-15 18:07:23.353: INFO @log_variables: train loss nanmean: 0.033764 2019-11-15 18:07:23.353: INFO @log_variables: train positive_distance nanmean: 0.554811 2019-11-15 18:07:23.353: INFO @log_variables: train negative_distance nanmean: 1.419425 2019-11-15 18:07:23.353: INFO @log_variables: valid loss nanmean: 0.275184 2019-11-15 18:07:23.353: INFO @log_variables: valid positive_distance nanmean: 0.677722 2019-11-15 18:07:23.354: INFO @log_variables: valid negative_distance nanmean: 1.400038 2019-11-15 18:07:23.354: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:08:58.236: INFO @metrics_hook: train matching accuracy: 0.9922779224537037, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-15 18:08:59.112: INFO @metrics_hook: valid matching accuracy: 0.9878425935800362, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:08:59.252: INFO @evaluate_embedding: best threshold 1.0388799607753754 2019-11-15 18:08:59.315: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:08:59.315: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:08:59.493: INFO @decay_lr : LR updated to `0.00013807551` 2019-11-15 18:08:59.494: INFO @log_profile : T train: 42.771748 2019-11-15 18:08:59.494: INFO @log_profile : T valid: 1.302826 2019-11-15 18:08:59.495: INFO @log_profile : T read data: 33.314747 2019-11-15 18:08:59.495: INFO @log_profile : T hooks: 101.156408 2019-11-15 18:08:59.495: INFO @main_loop : Epoch 395 done 2019-11-15 18:08:59.495: INFO @main_loop : Training epoch 396 2019-11-15 18:10:22.605: INFO @log_variables: train loss nanmean: 0.034469 2019-11-15 18:10:22.606: INFO @log_variables: train positive_distance nanmean: 0.554671 2019-11-15 18:10:22.606: INFO @log_variables: train negative_distance nanmean: 1.419421 2019-11-15 18:10:22.606: INFO @log_variables: valid loss nanmean: 0.272242 2019-11-15 18:10:22.606: INFO @log_variables: valid positive_distance nanmean: 0.677973 2019-11-15 18:10:22.606: INFO @log_variables: valid negative_distance nanmean: 1.400666 2019-11-15 18:10:22.606: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:11:54.393: INFO @metrics_hook: train matching accuracy: 0.9926667390046297, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 18:11:55.379: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:11:55.536: INFO @evaluate_embedding: best threshold 1.0393192470073698 2019-11-15 18:11:55.608: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:11:55.608: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:11:55.787: INFO @decay_lr : LR updated to `0.00013738514` 2019-11-15 18:11:55.789: INFO @log_profile : T train: 42.852036 2019-11-15 18:11:55.789: INFO @log_profile : T valid: 1.295427 2019-11-15 18:11:55.789: INFO @log_profile : T read data: 33.831357 2019-11-15 18:11:55.789: INFO @log_profile : T hooks: 98.247261 2019-11-15 18:11:55.789: INFO @main_loop : Epoch 396 done 2019-11-15 18:11:55.789: INFO @main_loop : Training epoch 397 2019-11-15 18:13:22.528: INFO @log_variables: train loss nanmean: 0.033834 2019-11-15 18:13:22.528: INFO @log_variables: train positive_distance nanmean: 0.554467 2019-11-15 18:13:22.528: INFO @log_variables: train negative_distance nanmean: 1.419431 2019-11-15 18:13:22.528: INFO @log_variables: valid loss nanmean: 0.276061 2019-11-15 18:13:22.528: INFO @log_variables: valid positive_distance nanmean: 0.679304 2019-11-15 18:13:22.528: INFO @log_variables: valid negative_distance nanmean: 1.400892 2019-11-15 18:13:22.528: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:14:56.699: INFO @metrics_hook: train matching accuracy: 0.9928203273352021, N=110590, DB_SIZE=110592, N_IDS=7309 2019-11-15 18:14:57.563: INFO @metrics_hook: valid matching accuracy: 0.9877359496640716, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:14:57.744: INFO @evaluate_embedding: best threshold 1.0400978326797485 2019-11-15 18:14:57.806: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:14:57.807: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:14:58.016: INFO @decay_lr : LR updated to `0.00013669822` 2019-11-15 18:14:58.017: INFO @log_profile : T train: 42.758831 2019-11-15 18:14:58.017: INFO @log_profile : T valid: 1.304214 2019-11-15 18:14:58.017: INFO @log_profile : T read data: 37.571607 2019-11-15 18:14:58.017: INFO @log_profile : T hooks: 100.525978 2019-11-15 18:14:58.018: INFO @main_loop : Epoch 397 done 2019-11-15 18:14:58.018: INFO @main_loop : Training epoch 398 2019-11-15 18:16:23.236: INFO @log_variables: train loss nanmean: 0.034376 2019-11-15 18:16:23.236: INFO @log_variables: train positive_distance nanmean: 0.555076 2019-11-15 18:16:23.236: INFO @log_variables: train negative_distance nanmean: 1.419407 2019-11-15 18:16:23.236: INFO @log_variables: valid loss nanmean: 0.273579 2019-11-15 18:16:23.237: INFO @log_variables: valid positive_distance nanmean: 0.679190 2019-11-15 18:16:23.237: INFO @log_variables: valid negative_distance nanmean: 1.400781 2019-11-15 18:16:23.237: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:17:55.277: INFO @metrics_hook: train matching accuracy: 0.9922688802083334, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 18:17:56.168: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:17:56.328: INFO @evaluate_embedding: best threshold 1.0399850606918335 2019-11-15 18:17:56.390: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:17:56.390: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:17:56.557: INFO @decay_lr : LR updated to `0.00013601473` 2019-11-15 18:17:56.559: INFO @log_profile : T train: 42.783195 2019-11-15 18:17:56.559: INFO @log_profile : T valid: 1.295766 2019-11-15 18:17:56.559: INFO @log_profile : T read data: 35.964596 2019-11-15 18:17:56.559: INFO @log_profile : T hooks: 98.428712 2019-11-15 18:17:56.559: INFO @main_loop : Epoch 398 done 2019-11-15 18:17:56.559: INFO @main_loop : Training epoch 399 2019-11-15 18:19:20.813: INFO @log_variables: train loss nanmean: 0.034784 2019-11-15 18:19:20.814: INFO @log_variables: train positive_distance nanmean: 0.554031 2019-11-15 18:19:20.814: INFO @log_variables: train negative_distance nanmean: 1.419438 2019-11-15 18:19:20.814: INFO @log_variables: valid loss nanmean: 0.275092 2019-11-15 18:19:20.814: INFO @log_variables: valid positive_distance nanmean: 0.678425 2019-11-15 18:19:20.814: INFO @log_variables: valid negative_distance nanmean: 1.400342 2019-11-15 18:19:20.814: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:20:55.233: INFO @metrics_hook: train matching accuracy: 0.9924044452080187, N=110591, DB_SIZE=110592, N_IDS=7317 2019-11-15 18:20:56.329: INFO @metrics_hook: valid matching accuracy: 0.9879492374960008, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:20:56.483: INFO @evaluate_embedding: best threshold 1.0393834710121153 2019-11-15 18:20:56.545: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:20:56.545: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:20:56.724: INFO @decay_lr : LR updated to `0.00013533466` 2019-11-15 18:20:56.726: INFO @log_profile : T train: 42.856854 2019-11-15 18:20:56.726: INFO @log_profile : T valid: 1.317467 2019-11-15 18:20:56.726: INFO @log_profile : T read data: 35.012149 2019-11-15 18:20:56.726: INFO @log_profile : T hooks: 100.912014 2019-11-15 18:20:56.726: INFO @main_loop : Epoch 399 done 2019-11-15 18:20:56.726: INFO @main_loop : Training epoch 400 2019-11-15 18:22:21.067: INFO @log_variables: train loss nanmean: 0.033686 2019-11-15 18:22:21.068: INFO @log_variables: train positive_distance nanmean: 0.554909 2019-11-15 18:22:21.068: INFO @log_variables: train negative_distance nanmean: 1.419421 2019-11-15 18:22:21.068: INFO @log_variables: valid loss nanmean: 0.274178 2019-11-15 18:22:21.068: INFO @log_variables: valid positive_distance nanmean: 0.678228 2019-11-15 18:22:21.068: INFO @log_variables: valid negative_distance nanmean: 1.400348 2019-11-15 18:22:21.068: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:23:54.150: INFO @metrics_hook: train matching accuracy: 0.9920970060854861, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-15 18:23:55.055: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:23:55.215: INFO @evaluate_embedding: best threshold 1.0392882525920868 2019-11-15 18:23:55.277: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:23:55.277: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:23:55.457: INFO @decay_lr : LR updated to `0.00013465798` 2019-11-15 18:23:55.459: INFO @log_profile : T train: 43.664225 2019-11-15 18:23:55.459: INFO @log_profile : T valid: 1.412015 2019-11-15 18:23:55.459: INFO @log_profile : T read data: 34.083106 2019-11-15 18:23:55.459: INFO @log_profile : T hooks: 99.505087 2019-11-15 18:23:55.459: INFO @main_loop : Epoch 400 done 2019-11-15 18:23:55.459: INFO @main_loop : Training epoch 401 2019-11-15 18:25:20.529: INFO @log_variables: train loss nanmean: 0.033895 2019-11-15 18:25:20.529: INFO @log_variables: train positive_distance nanmean: 0.554351 2019-11-15 18:25:20.529: INFO @log_variables: train negative_distance nanmean: 1.419422 2019-11-15 18:25:20.529: INFO @log_variables: valid loss nanmean: 0.275714 2019-11-15 18:25:20.529: INFO @log_variables: valid positive_distance nanmean: 0.677999 2019-11-15 18:25:20.529: INFO @log_variables: valid negative_distance nanmean: 1.400161 2019-11-15 18:25:20.529: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:26:54.452: INFO @metrics_hook: train matching accuracy: 0.9920427521226863, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-15 18:26:55.324: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:26:55.489: INFO @evaluate_embedding: best threshold 1.0390799939632414 2019-11-15 18:26:55.557: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:26:55.557: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:26:55.729: INFO @decay_lr : LR updated to `0.0001339847` 2019-11-15 18:26:55.731: INFO @log_profile : T train: 42.668591 2019-11-15 18:26:55.731: INFO @log_profile : T valid: 1.303420 2019-11-15 18:26:55.731: INFO @log_profile : T read data: 35.942221 2019-11-15 18:26:55.731: INFO @log_profile : T hooks: 100.289742 2019-11-15 18:26:55.731: INFO @main_loop : Epoch 401 done 2019-11-15 18:26:55.731: INFO @main_loop : Training epoch 402 2019-11-15 18:28:19.873: INFO @log_variables: train loss nanmean: 0.033690 2019-11-15 18:28:19.873: INFO @log_variables: train positive_distance nanmean: 0.554279 2019-11-15 18:28:19.873: INFO @log_variables: train negative_distance nanmean: 1.419428 2019-11-15 18:28:19.873: INFO @log_variables: valid loss nanmean: 0.276460 2019-11-15 18:28:19.873: INFO @log_variables: valid positive_distance nanmean: 0.679825 2019-11-15 18:28:19.873: INFO @log_variables: valid negative_distance nanmean: 1.400494 2019-11-15 18:28:19.874: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:29:53.440: INFO @metrics_hook: train matching accuracy: 0.9917534722222222, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 18:29:54.319: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:29:54.487: INFO @evaluate_embedding: best threshold 1.0401592552661896 2019-11-15 18:29:54.560: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:29:54.560: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:29:54.736: INFO @decay_lr : LR updated to `0.00013331477` 2019-11-15 18:29:54.738: INFO @log_profile : T train: 43.885740 2019-11-15 18:29:54.738: INFO @log_profile : T valid: 1.413018 2019-11-15 18:29:54.738: INFO @log_profile : T read data: 33.972980 2019-11-15 18:29:54.738: INFO @log_profile : T hooks: 99.667130 2019-11-15 18:29:54.738: INFO @main_loop : Epoch 402 done 2019-11-15 18:29:54.738: INFO @main_loop : Training epoch 403 2019-11-15 18:31:18.932: INFO @log_variables: train loss nanmean: 0.033941 2019-11-15 18:31:18.932: INFO @log_variables: train positive_distance nanmean: 0.555047 2019-11-15 18:31:18.932: INFO @log_variables: train negative_distance nanmean: 1.419418 2019-11-15 18:31:18.932: INFO @log_variables: valid loss nanmean: 0.273547 2019-11-15 18:31:18.932: INFO @log_variables: valid positive_distance nanmean: 0.678072 2019-11-15 18:31:18.932: INFO @log_variables: valid negative_distance nanmean: 1.400597 2019-11-15 18:31:18.932: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:32:52.396: INFO @metrics_hook: train matching accuracy: 0.9920880353009259, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-15 18:32:53.218: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:32:53.389: INFO @evaluate_embedding: best threshold 1.0393344759941103 2019-11-15 18:32:53.454: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:32:53.455: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:32:53.632: INFO @decay_lr : LR updated to `0.00013264819` 2019-11-15 18:32:53.633: INFO @log_profile : T train: 42.809283 2019-11-15 18:32:53.634: INFO @log_profile : T valid: 1.282066 2019-11-15 18:32:53.634: INFO @log_profile : T read data: 35.059331 2019-11-15 18:32:53.634: INFO @log_profile : T hooks: 99.677232 2019-11-15 18:32:53.634: INFO @main_loop : Epoch 403 done 2019-11-15 18:32:53.634: INFO @main_loop : Training epoch 404 2019-11-15 18:34:18.561: INFO @log_variables: train loss nanmean: 0.034331 2019-11-15 18:34:18.561: INFO @log_variables: train positive_distance nanmean: 0.554743 2019-11-15 18:34:18.562: INFO @log_variables: train negative_distance nanmean: 1.419431 2019-11-15 18:34:18.562: INFO @log_variables: valid loss nanmean: 0.273685 2019-11-15 18:34:18.562: INFO @log_variables: valid positive_distance nanmean: 0.680071 2019-11-15 18:34:18.562: INFO @log_variables: valid negative_distance nanmean: 1.400579 2019-11-15 18:34:18.562: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:35:51.542: INFO @metrics_hook: train matching accuracy: 0.9926667390046297, N=110592, DB_SIZE=110592, N_IDS=7317 2019-11-15 18:35:52.395: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:35:52.559: INFO @evaluate_embedding: best threshold 1.0403250455856325 2019-11-15 18:35:52.624: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:35:52.624: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:35:52.801: INFO @decay_lr : LR updated to `0.00013198494` 2019-11-15 18:35:52.802: INFO @log_profile : T train: 43.420625 2019-11-15 18:35:52.802: INFO @log_profile : T valid: 1.423923 2019-11-15 18:35:52.802: INFO @log_profile : T read data: 34.884237 2019-11-15 18:35:52.802: INFO @log_profile : T hooks: 99.371443 2019-11-15 18:35:52.802: INFO @main_loop : Epoch 404 done 2019-11-15 18:35:52.802: INFO @main_loop : Training epoch 405 2019-11-15 18:37:16.313: INFO @log_variables: train loss nanmean: 0.033910 2019-11-15 18:37:16.313: INFO @log_variables: train positive_distance nanmean: 0.554966 2019-11-15 18:37:16.313: INFO @log_variables: train negative_distance nanmean: 1.419421 2019-11-15 18:37:16.313: INFO @log_variables: valid loss nanmean: 0.273664 2019-11-15 18:37:16.313: INFO @log_variables: valid positive_distance nanmean: 0.678837 2019-11-15 18:37:16.313: INFO @log_variables: valid negative_distance nanmean: 1.400557 2019-11-15 18:37:16.313: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:38:47.160: INFO @metrics_hook: train matching accuracy: 0.9918710214120371, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 18:38:48.012: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:38:48.173: INFO @evaluate_embedding: best threshold 1.0396969020366669 2019-11-15 18:38:48.241: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:38:48.241: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:38:48.425: INFO @decay_lr : LR updated to `0.00013132501` 2019-11-15 18:38:48.427: INFO @log_profile : T train: 44.040371 2019-11-15 18:38:48.427: INFO @log_profile : T valid: 1.405917 2019-11-15 18:38:48.427: INFO @log_profile : T read data: 33.002200 2019-11-15 18:38:48.427: INFO @log_profile : T hooks: 97.108158 2019-11-15 18:38:48.427: INFO @main_loop : Epoch 405 done 2019-11-15 18:38:48.427: INFO @main_loop : Training epoch 406 2019-11-15 18:40:12.401: INFO @log_variables: train loss nanmean: 0.033355 2019-11-15 18:40:12.401: INFO @log_variables: train positive_distance nanmean: 0.554544 2019-11-15 18:40:12.401: INFO @log_variables: train negative_distance nanmean: 1.419415 2019-11-15 18:40:12.401: INFO @log_variables: valid loss nanmean: 0.277110 2019-11-15 18:40:12.401: INFO @log_variables: valid positive_distance nanmean: 0.679148 2019-11-15 18:40:12.401: INFO @log_variables: valid negative_distance nanmean: 1.400095 2019-11-15 18:40:12.401: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:41:45.220: INFO @metrics_hook: train matching accuracy: 0.9919976128472222, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 18:41:46.212: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:41:46.371: INFO @evaluate_embedding: best threshold 1.0396216809749605 2019-11-15 18:41:46.437: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:41:46.437: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:41:46.625: INFO @decay_lr : LR updated to `0.00013066838` 2019-11-15 18:41:46.626: INFO @log_profile : T train: 42.744756 2019-11-15 18:41:46.627: INFO @log_profile : T valid: 1.297564 2019-11-15 18:41:46.627: INFO @log_profile : T read data: 34.705994 2019-11-15 18:41:46.627: INFO @log_profile : T hooks: 99.383251 2019-11-15 18:41:46.627: INFO @main_loop : Epoch 406 done 2019-11-15 18:41:46.627: INFO @main_loop : Training epoch 407 2019-11-15 18:43:10.410: INFO @log_variables: train loss nanmean: 0.033700 2019-11-15 18:43:10.410: INFO @log_variables: train positive_distance nanmean: 0.554429 2019-11-15 18:43:10.410: INFO @log_variables: train negative_distance nanmean: 1.419413 2019-11-15 18:43:10.410: INFO @log_variables: valid loss nanmean: 0.274778 2019-11-15 18:43:10.410: INFO @log_variables: valid positive_distance nanmean: 0.679167 2019-11-15 18:43:10.410: INFO @log_variables: valid negative_distance nanmean: 1.400208 2019-11-15 18:43:10.410: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:44:43.473: INFO @metrics_hook: train matching accuracy: 0.992295937282419, N=110591, DB_SIZE=110592, N_IDS=7317 2019-11-15 18:44:44.346: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:44:44.499: INFO @evaluate_embedding: best threshold 1.0396876633167267 2019-11-15 18:44:44.562: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:44:44.562: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:44:44.739: INFO @decay_lr : LR updated to `0.00013001505` 2019-11-15 18:44:44.740: INFO @log_profile : T train: 42.682210 2019-11-15 18:44:44.740: INFO @log_profile : T valid: 1.292091 2019-11-15 18:44:44.740: INFO @log_profile : T read data: 34.691793 2019-11-15 18:44:44.741: INFO @log_profile : T hooks: 99.376587 2019-11-15 18:44:44.741: INFO @main_loop : Epoch 407 done 2019-11-15 18:44:44.741: INFO @main_loop : Training epoch 408 2019-11-15 18:46:07.826: INFO @log_variables: train loss nanmean: 0.034478 2019-11-15 18:46:07.826: INFO @log_variables: train positive_distance nanmean: 0.554984 2019-11-15 18:46:07.826: INFO @log_variables: train negative_distance nanmean: 1.419423 2019-11-15 18:46:07.826: INFO @log_variables: valid loss nanmean: 0.274095 2019-11-15 18:46:07.826: INFO @log_variables: valid positive_distance nanmean: 0.679499 2019-11-15 18:46:07.826: INFO @log_variables: valid negative_distance nanmean: 1.400309 2019-11-15 18:46:07.826: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:47:42.313: INFO @metrics_hook: train matching accuracy: 0.9923773871527778, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 18:47:43.241: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:47:43.397: INFO @evaluate_embedding: best threshold 1.0399042069911957 2019-11-15 18:47:43.458: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:47:43.459: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:47:43.654: INFO @decay_lr : LR updated to `0.00012936497` 2019-11-15 18:47:43.655: INFO @log_profile : T train: 42.643978 2019-11-15 18:47:43.655: INFO @log_profile : T valid: 1.297791 2019-11-15 18:47:43.655: INFO @log_profile : T read data: 34.297524 2019-11-15 18:47:43.655: INFO @log_profile : T hooks: 100.608225 2019-11-15 18:47:43.655: INFO @main_loop : Epoch 408 done 2019-11-15 18:47:43.655: INFO @main_loop : Training epoch 409 2019-11-15 18:49:07.361: INFO @log_variables: train loss nanmean: 0.033374 2019-11-15 18:49:07.361: INFO @log_variables: train positive_distance nanmean: 0.554473 2019-11-15 18:49:07.361: INFO @log_variables: train negative_distance nanmean: 1.419436 2019-11-15 18:49:07.361: INFO @log_variables: valid loss nanmean: 0.275389 2019-11-15 18:49:07.361: INFO @log_variables: valid positive_distance nanmean: 0.680253 2019-11-15 18:49:07.361: INFO @log_variables: valid negative_distance nanmean: 1.400185 2019-11-15 18:49:07.362: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:50:41.649: INFO @metrics_hook: train matching accuracy: 0.9931188512731481, N=110592, DB_SIZE=110592, N_IDS=7305 2019-11-15 18:50:42.675: INFO @metrics_hook: valid matching accuracy: 0.9879492374960008, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:50:42.828: INFO @evaluate_embedding: best threshold 1.0402191281318667 2019-11-15 18:50:42.890: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:50:42.890: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:50:43.070: INFO @decay_lr : LR updated to `0.00012871815` 2019-11-15 18:50:43.072: INFO @log_profile : T train: 42.911656 2019-11-15 18:50:43.072: INFO @log_profile : T valid: 1.291589 2019-11-15 18:50:43.072: INFO @log_profile : T read data: 34.207483 2019-11-15 18:50:43.072: INFO @log_profile : T hooks: 100.935013 2019-11-15 18:50:43.072: INFO @main_loop : Epoch 409 done 2019-11-15 18:50:43.072: INFO @main_loop : Training epoch 410 2019-11-15 18:52:08.359: INFO @log_variables: train loss nanmean: 0.033744 2019-11-15 18:52:08.359: INFO @log_variables: train positive_distance nanmean: 0.553949 2019-11-15 18:52:08.359: INFO @log_variables: train negative_distance nanmean: 1.419426 2019-11-15 18:52:08.359: INFO @log_variables: valid loss nanmean: 0.275073 2019-11-15 18:52:08.360: INFO @log_variables: valid positive_distance nanmean: 0.678846 2019-11-15 18:52:08.360: INFO @log_variables: valid negative_distance nanmean: 1.400657 2019-11-15 18:52:08.360: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:53:41.898: INFO @metrics_hook: train matching accuracy: 0.9920789930555556, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 18:53:42.718: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:53:42.854: INFO @evaluate_embedding: best threshold 1.0397512316703796 2019-11-15 18:53:42.917: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:53:42.918: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:53:43.093: INFO @decay_lr : LR updated to `0.00012807456` 2019-11-15 18:53:43.095: INFO @log_profile : T train: 42.833637 2019-11-15 18:53:43.095: INFO @log_profile : T valid: 1.291999 2019-11-15 18:53:43.095: INFO @log_profile : T read data: 36.258093 2019-11-15 18:53:43.095: INFO @log_profile : T hooks: 99.570611 2019-11-15 18:53:43.095: INFO @main_loop : Epoch 410 done 2019-11-15 18:53:43.095: INFO @main_loop : Training epoch 411 2019-11-15 18:55:08.549: INFO @log_variables: train loss nanmean: 0.033942 2019-11-15 18:55:08.549: INFO @log_variables: train positive_distance nanmean: 0.554478 2019-11-15 18:55:08.549: INFO @log_variables: train negative_distance nanmean: 1.419440 2019-11-15 18:55:08.549: INFO @log_variables: valid loss nanmean: 0.273789 2019-11-15 18:55:08.549: INFO @log_variables: valid positive_distance nanmean: 0.679235 2019-11-15 18:55:08.549: INFO @log_variables: valid negative_distance nanmean: 1.400287 2019-11-15 18:55:08.549: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:56:42.863: INFO @metrics_hook: train matching accuracy: 0.9916540075231481, N=110592, DB_SIZE=110592, N_IDS=7302 2019-11-15 18:56:43.645: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:56:43.784: INFO @evaluate_embedding: best threshold 1.0397613048553467 2019-11-15 18:56:43.858: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:56:43.858: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:56:44.030: INFO @decay_lr : LR updated to `0.00012743419` 2019-11-15 18:56:44.032: INFO @log_profile : T train: 43.873565 2019-11-15 18:56:44.032: INFO @log_profile : T valid: 1.397690 2019-11-15 18:56:44.032: INFO @log_profile : T read data: 34.985684 2019-11-15 18:56:44.032: INFO @log_profile : T hooks: 100.611531 2019-11-15 18:56:44.032: INFO @main_loop : Epoch 411 done 2019-11-15 18:56:44.032: INFO @main_loop : Training epoch 412 2019-11-15 18:58:08.702: INFO @log_variables: train loss nanmean: 0.032718 2019-11-15 18:58:08.702: INFO @log_variables: train positive_distance nanmean: 0.553213 2019-11-15 18:58:08.702: INFO @log_variables: train negative_distance nanmean: 1.419424 2019-11-15 18:58:08.702: INFO @log_variables: valid loss nanmean: 0.275255 2019-11-15 18:58:08.702: INFO @log_variables: valid positive_distance nanmean: 0.678469 2019-11-15 18:58:08.702: INFO @log_variables: valid negative_distance nanmean: 1.400450 2019-11-15 18:58:08.702: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 18:59:41.538: INFO @metrics_hook: train matching accuracy: 0.9923593026620371, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 18:59:42.439: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 18:59:42.618: INFO @evaluate_embedding: best threshold 1.0394593179225924 2019-11-15 18:59:42.685: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 18:59:42.685: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 18:59:42.855: INFO @decay_lr : LR updated to `0.00012679702` 2019-11-15 18:59:42.857: INFO @log_profile : T train: 43.718491 2019-11-15 18:59:42.857: INFO @log_profile : T valid: 1.419106 2019-11-15 18:59:42.857: INFO @log_profile : T read data: 34.487101 2019-11-15 18:59:42.857: INFO @log_profile : T hooks: 99.131370 2019-11-15 18:59:42.857: INFO @main_loop : Epoch 412 done 2019-11-15 18:59:42.857: INFO @main_loop : Training epoch 413 2019-11-15 19:01:06.569: INFO @log_variables: train loss nanmean: 0.033022 2019-11-15 19:01:06.569: INFO @log_variables: train positive_distance nanmean: 0.554522 2019-11-15 19:01:06.569: INFO @log_variables: train negative_distance nanmean: 1.419430 2019-11-15 19:01:06.570: INFO @log_variables: valid loss nanmean: 0.275128 2019-11-15 19:01:06.570: INFO @log_variables: valid positive_distance nanmean: 0.679610 2019-11-15 19:01:06.570: INFO @log_variables: valid negative_distance nanmean: 1.400820 2019-11-15 19:01:06.570: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:02:41.600: INFO @metrics_hook: train matching accuracy: 0.9920789214312196, N=110591, DB_SIZE=110592, N_IDS=7310 2019-11-15 19:02:42.596: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:02:42.755: INFO @evaluate_embedding: best threshold 1.0402154624462128 2019-11-15 19:02:42.821: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:02:42.821: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:02:43.003: INFO @decay_lr : LR updated to `0.00012616304` 2019-11-15 19:02:43.004: INFO @log_profile : T train: 44.088524 2019-11-15 19:02:43.004: INFO @log_profile : T valid: 1.414852 2019-11-15 19:02:43.004: INFO @log_profile : T read data: 33.205185 2019-11-15 19:02:43.004: INFO @log_profile : T hooks: 101.371108 2019-11-15 19:02:43.005: INFO @main_loop : Epoch 413 done 2019-11-15 19:02:43.005: INFO @main_loop : Training epoch 414 2019-11-15 19:04:08.062: INFO @log_variables: train loss nanmean: 0.032655 2019-11-15 19:04:08.062: INFO @log_variables: train positive_distance nanmean: 0.553628 2019-11-15 19:04:08.062: INFO @log_variables: train negative_distance nanmean: 1.419418 2019-11-15 19:04:08.062: INFO @log_variables: valid loss nanmean: 0.274868 2019-11-15 19:04:08.062: INFO @log_variables: valid positive_distance nanmean: 0.677785 2019-11-15 19:04:08.062: INFO @log_variables: valid negative_distance nanmean: 1.400441 2019-11-15 19:04:08.062: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:05:43.525: INFO @metrics_hook: train matching accuracy: 0.9919071172156866, N=110591, DB_SIZE=110592, N_IDS=7308 2019-11-15 19:05:44.317: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:05:44.497: INFO @evaluate_embedding: best threshold 1.039112716913223 2019-11-15 19:05:44.567: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:05:44.567: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:05:44.736: INFO @decay_lr : LR updated to `0.00012553223` 2019-11-15 19:05:44.738: INFO @log_profile : T train: 42.864717 2019-11-15 19:05:44.738: INFO @log_profile : T valid: 1.301457 2019-11-15 19:05:44.738: INFO @log_profile : T read data: 35.747745 2019-11-15 19:05:44.738: INFO @log_profile : T hooks: 101.751979 2019-11-15 19:05:44.738: INFO @main_loop : Epoch 414 done 2019-11-15 19:05:44.738: INFO @main_loop : Training epoch 415 2019-11-15 19:07:08.819: INFO @log_variables: train loss nanmean: 0.033833 2019-11-15 19:07:08.819: INFO @log_variables: train positive_distance nanmean: 0.554476 2019-11-15 19:07:08.819: INFO @log_variables: train negative_distance nanmean: 1.419420 2019-11-15 19:07:08.819: INFO @log_variables: valid loss nanmean: 0.275024 2019-11-15 19:07:08.819: INFO @log_variables: valid positive_distance nanmean: 0.678203 2019-11-15 19:07:08.819: INFO @log_variables: valid negative_distance nanmean: 1.400487 2019-11-15 19:07:08.819: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:08:43.042: INFO @metrics_hook: train matching accuracy: 0.9926305700231481, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-15 19:08:44.054: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:08:44.227: INFO @evaluate_embedding: best threshold 1.039344698190689 2019-11-15 19:08:44.290: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:08:44.290: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:08:44.467: INFO @decay_lr : LR updated to `0.00012490456` 2019-11-15 19:08:44.468: INFO @log_profile : T train: 42.803821 2019-11-15 19:08:44.468: INFO @log_profile : T valid: 1.290781 2019-11-15 19:08:44.468: INFO @log_profile : T read data: 35.001664 2019-11-15 19:08:44.468: INFO @log_profile : T hooks: 100.565125 2019-11-15 19:08:44.468: INFO @main_loop : Epoch 415 done 2019-11-15 19:08:44.469: INFO @main_loop : Training epoch 416 2019-11-15 19:10:11.307: INFO @log_variables: train loss nanmean: 0.033210 2019-11-15 19:10:11.308: INFO @log_variables: train positive_distance nanmean: 0.554564 2019-11-15 19:10:11.308: INFO @log_variables: train negative_distance nanmean: 1.419440 2019-11-15 19:10:11.308: INFO @log_variables: valid loss nanmean: 0.273537 2019-11-15 19:10:11.308: INFO @log_variables: valid positive_distance nanmean: 0.678530 2019-11-15 19:10:11.308: INFO @log_variables: valid negative_distance nanmean: 1.400757 2019-11-15 19:10:11.308: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:11:45.399: INFO @metrics_hook: train matching accuracy: 0.9925399452025065, N=110589, DB_SIZE=110592, N_IDS=7313 2019-11-15 19:11:46.409: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:11:46.577: INFO @evaluate_embedding: best threshold 1.0396435558795927 2019-11-15 19:11:46.640: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:11:46.640: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:11:46.827: INFO @decay_lr : LR updated to `0.00012428004` 2019-11-15 19:11:46.829: INFO @log_profile : T train: 43.072854 2019-11-15 19:11:46.829: INFO @log_profile : T valid: 1.298446 2019-11-15 19:11:46.829: INFO @log_profile : T read data: 37.488444 2019-11-15 19:11:46.829: INFO @log_profile : T hooks: 100.432783 2019-11-15 19:11:46.829: INFO @main_loop : Epoch 416 done 2019-11-15 19:11:46.829: INFO @main_loop : Training epoch 417 2019-11-15 19:13:11.172: INFO @log_variables: train loss nanmean: 0.033699 2019-11-15 19:13:11.172: INFO @log_variables: train positive_distance nanmean: 0.554142 2019-11-15 19:13:11.172: INFO @log_variables: train negative_distance nanmean: 1.419415 2019-11-15 19:13:11.172: INFO @log_variables: valid loss nanmean: 0.273302 2019-11-15 19:13:11.172: INFO @log_variables: valid positive_distance nanmean: 0.679183 2019-11-15 19:13:11.172: INFO @log_variables: valid negative_distance nanmean: 1.400846 2019-11-15 19:13:11.172: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:14:43.427: INFO @metrics_hook: train matching accuracy: 0.9923049796095523, N=110591, DB_SIZE=110592, N_IDS=7309 2019-11-15 19:14:44.173: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:14:44.321: INFO @evaluate_embedding: best threshold 1.0400145649909973 2019-11-15 19:14:44.388: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:14:44.388: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:14:44.567: INFO @decay_lr : LR updated to `0.00012365864` 2019-11-15 19:14:44.569: INFO @log_profile : T train: 42.759806 2019-11-15 19:14:44.569: INFO @log_profile : T valid: 1.305267 2019-11-15 19:14:44.569: INFO @log_profile : T read data: 35.306433 2019-11-15 19:14:44.569: INFO @log_profile : T hooks: 98.300146 2019-11-15 19:14:44.569: INFO @main_loop : Epoch 417 done 2019-11-15 19:14:44.569: INFO @main_loop : Training epoch 418 2019-11-15 19:16:08.505: INFO @log_variables: train loss nanmean: 0.033125 2019-11-15 19:16:08.505: INFO @log_variables: train positive_distance nanmean: 0.553537 2019-11-15 19:16:08.505: INFO @log_variables: train negative_distance nanmean: 1.419424 2019-11-15 19:16:08.505: INFO @log_variables: valid loss nanmean: 0.273147 2019-11-15 19:16:08.505: INFO @log_variables: valid positive_distance nanmean: 0.680085 2019-11-15 19:16:08.505: INFO @log_variables: valid negative_distance nanmean: 1.400731 2019-11-15 19:16:08.505: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:17:41.461: INFO @metrics_hook: train matching accuracy: 0.9919343171296297, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-15 19:17:42.280: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:17:42.435: INFO @evaluate_embedding: best threshold 1.0404075980186462 2019-11-15 19:17:42.502: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:17:42.502: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:17:42.674: INFO @decay_lr : LR updated to `0.00012304034` 2019-11-15 19:17:42.675: INFO @log_profile : T train: 42.825032 2019-11-15 19:17:42.675: INFO @log_profile : T valid: 1.293395 2019-11-15 19:17:42.675: INFO @log_profile : T read data: 34.786827 2019-11-15 19:17:42.675: INFO @log_profile : T hooks: 99.133905 2019-11-15 19:17:42.675: INFO @main_loop : Epoch 418 done 2019-11-15 19:17:42.676: INFO @main_loop : Training epoch 419 2019-11-15 19:19:07.582: INFO @log_variables: train loss nanmean: 0.033714 2019-11-15 19:19:07.582: INFO @log_variables: train positive_distance nanmean: 0.554922 2019-11-15 19:19:07.582: INFO @log_variables: train negative_distance nanmean: 1.419441 2019-11-15 19:19:07.582: INFO @log_variables: valid loss nanmean: 0.274339 2019-11-15 19:19:07.582: INFO @log_variables: valid positive_distance nanmean: 0.679799 2019-11-15 19:19:07.582: INFO @log_variables: valid negative_distance nanmean: 1.400581 2019-11-15 19:19:07.583: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:20:40.989: INFO @metrics_hook: train matching accuracy: 0.9925401475694444, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 19:20:41.997: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:20:42.170: INFO @evaluate_embedding: best threshold 1.0401901006698606 2019-11-15 19:20:42.239: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:20:42.239: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:20:42.423: INFO @decay_lr : LR updated to `0.00012242515` 2019-11-15 19:20:42.424: INFO @log_profile : T train: 42.803947 2019-11-15 19:20:42.424: INFO @log_profile : T valid: 1.312071 2019-11-15 19:20:42.424: INFO @log_profile : T read data: 35.737645 2019-11-15 19:20:42.425: INFO @log_profile : T hooks: 99.826801 2019-11-15 19:20:42.425: INFO @main_loop : Epoch 419 done 2019-11-15 19:20:42.425: INFO @main_loop : Training epoch 420 2019-11-15 19:22:06.425: INFO @log_variables: train loss nanmean: 0.032996 2019-11-15 19:22:06.426: INFO @log_variables: train positive_distance nanmean: 0.553150 2019-11-15 19:22:06.426: INFO @log_variables: train negative_distance nanmean: 1.419439 2019-11-15 19:22:06.426: INFO @log_variables: valid loss nanmean: 0.273494 2019-11-15 19:22:06.426: INFO @log_variables: valid positive_distance nanmean: 0.679247 2019-11-15 19:22:06.426: INFO @log_variables: valid negative_distance nanmean: 1.400508 2019-11-15 19:22:06.426: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:23:41.648: INFO @metrics_hook: train matching accuracy: 0.992413487535152, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 19:23:42.431: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:23:42.591: INFO @evaluate_embedding: best threshold 1.039877563714981 2019-11-15 19:23:42.654: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:23:42.654: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:23:42.862: INFO @decay_lr : LR updated to `0.00012181302` 2019-11-15 19:23:42.863: INFO @log_profile : T train: 44.088290 2019-11-15 19:23:42.863: INFO @log_profile : T valid: 1.422836 2019-11-15 19:23:42.863: INFO @log_profile : T read data: 33.298365 2019-11-15 19:23:42.863: INFO @log_profile : T hooks: 101.561121 2019-11-15 19:23:42.863: INFO @main_loop : Epoch 420 done 2019-11-15 19:23:42.864: INFO @main_loop : Training epoch 421 2019-11-15 19:25:07.804: INFO @log_variables: train loss nanmean: 0.033593 2019-11-15 19:25:07.804: INFO @log_variables: train positive_distance nanmean: 0.554959 2019-11-15 19:25:07.804: INFO @log_variables: train negative_distance nanmean: 1.419427 2019-11-15 19:25:07.804: INFO @log_variables: valid loss nanmean: 0.273845 2019-11-15 19:25:07.804: INFO @log_variables: valid positive_distance nanmean: 0.679953 2019-11-15 19:25:07.804: INFO @log_variables: valid negative_distance nanmean: 1.400671 2019-11-15 19:25:07.804: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:26:40.973: INFO @metrics_hook: train matching accuracy: 0.9927481192129629, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 19:26:41.851: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:26:42.000: INFO @evaluate_embedding: best threshold 1.0403120219707491 2019-11-15 19:26:42.067: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:26:42.068: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:26:42.253: INFO @decay_lr : LR updated to `0.00012120396` 2019-11-15 19:26:42.254: INFO @log_profile : T train: 43.260517 2019-11-15 19:26:42.254: INFO @log_profile : T valid: 1.307060 2019-11-15 19:26:42.254: INFO @log_profile : T read data: 35.403008 2019-11-15 19:26:42.254: INFO @log_profile : T hooks: 99.351472 2019-11-15 19:26:42.255: INFO @main_loop : Epoch 421 done 2019-11-15 19:26:42.255: INFO @main_loop : Training epoch 422 2019-11-15 19:28:05.675: INFO @log_variables: train loss nanmean: 0.033417 2019-11-15 19:28:05.675: INFO @log_variables: train positive_distance nanmean: 0.554734 2019-11-15 19:28:05.675: INFO @log_variables: train negative_distance nanmean: 1.419435 2019-11-15 19:28:05.675: INFO @log_variables: valid loss nanmean: 0.273646 2019-11-15 19:28:05.675: INFO @log_variables: valid positive_distance nanmean: 0.679449 2019-11-15 19:28:05.675: INFO @log_variables: valid negative_distance nanmean: 1.400503 2019-11-15 19:28:05.675: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:29:38.296: INFO @metrics_hook: train matching accuracy: 0.9926937996762847, N=110591, DB_SIZE=110592, N_IDS=7318 2019-11-15 19:29:39.356: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:29:39.513: INFO @evaluate_embedding: best threshold 1.0399758517742157 2019-11-15 19:29:39.579: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:29:39.579: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:29:39.768: INFO @decay_lr : LR updated to `0.000120597935` 2019-11-15 19:29:39.769: INFO @log_profile : T train: 42.883803 2019-11-15 19:29:39.769: INFO @log_profile : T valid: 1.295585 2019-11-15 19:29:39.769: INFO @log_profile : T read data: 34.180797 2019-11-15 19:29:39.770: INFO @log_profile : T hooks: 99.085442 2019-11-15 19:29:39.770: INFO @main_loop : Epoch 422 done 2019-11-15 19:29:39.770: INFO @main_loop : Training epoch 423 2019-11-15 19:31:06.825: INFO @log_variables: train loss nanmean: 0.032444 2019-11-15 19:31:06.825: INFO @log_variables: train positive_distance nanmean: 0.552790 2019-11-15 19:31:06.826: INFO @log_variables: train negative_distance nanmean: 1.419449 2019-11-15 19:31:06.826: INFO @log_variables: valid loss nanmean: 0.275065 2019-11-15 19:31:06.826: INFO @log_variables: valid positive_distance nanmean: 0.679639 2019-11-15 19:31:06.826: INFO @log_variables: valid negative_distance nanmean: 1.400565 2019-11-15 19:31:06.826: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:32:41.957: INFO @metrics_hook: train matching accuracy: 0.9925038430237816, N=110590, DB_SIZE=110592, N_IDS=7317 2019-11-15 19:32:43.025: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:32:43.184: INFO @evaluate_embedding: best threshold 1.0401016473770142 2019-11-15 19:32:43.252: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:32:43.252: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:32:43.434: INFO @decay_lr : LR updated to `0.00011999495` 2019-11-15 19:32:43.436: INFO @log_profile : T train: 42.813489 2019-11-15 19:32:43.436: INFO @log_profile : T valid: 1.304002 2019-11-15 19:32:43.436: INFO @log_profile : T read data: 37.653356 2019-11-15 19:32:43.436: INFO @log_profile : T hooks: 101.827348 2019-11-15 19:32:43.436: INFO @main_loop : Epoch 423 done 2019-11-15 19:32:43.436: INFO @main_loop : Training epoch 424 2019-11-15 19:34:06.359: INFO @log_variables: train loss nanmean: 0.033170 2019-11-15 19:34:06.359: INFO @log_variables: train positive_distance nanmean: 0.554318 2019-11-15 19:34:06.359: INFO @log_variables: train negative_distance nanmean: 1.419436 2019-11-15 19:34:06.359: INFO @log_variables: valid loss nanmean: 0.274575 2019-11-15 19:34:06.359: INFO @log_variables: valid positive_distance nanmean: 0.680153 2019-11-15 19:34:06.360: INFO @log_variables: valid negative_distance nanmean: 1.400579 2019-11-15 19:34:06.360: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:35:39.737: INFO @metrics_hook: train matching accuracy: 0.9919071903935185, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-15 19:35:40.380: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:35:40.547: INFO @evaluate_embedding: best threshold 1.0403661429882047 2019-11-15 19:35:40.607: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:35:40.607: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:35:40.782: INFO @decay_lr : LR updated to `0.00011939497` 2019-11-15 19:35:40.783: INFO @log_profile : T train: 43.012876 2019-11-15 19:35:40.783: INFO @log_profile : T valid: 1.291748 2019-11-15 19:35:40.783: INFO @log_profile : T read data: 33.481719 2019-11-15 19:35:40.783: INFO @log_profile : T hooks: 99.493376 2019-11-15 19:35:40.783: INFO @main_loop : Epoch 424 done 2019-11-15 19:35:40.783: INFO @main_loop : Training epoch 425 2019-11-15 19:37:03.657: INFO @log_variables: train loss nanmean: 0.034082 2019-11-15 19:37:03.657: INFO @log_variables: train positive_distance nanmean: 0.554215 2019-11-15 19:37:03.657: INFO @log_variables: train negative_distance nanmean: 1.419445 2019-11-15 19:37:03.657: INFO @log_variables: valid loss nanmean: 0.273175 2019-11-15 19:37:03.657: INFO @log_variables: valid positive_distance nanmean: 0.677577 2019-11-15 19:37:03.658: INFO @log_variables: valid negative_distance nanmean: 1.400333 2019-11-15 19:37:03.658: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:38:38.706: INFO @metrics_hook: train matching accuracy: 0.992440614516552, N=110591, DB_SIZE=110592, N_IDS=7312 2019-11-15 19:38:39.479: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:38:39.620: INFO @evaluate_embedding: best threshold 1.038955181837082 2019-11-15 19:38:39.681: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:38:39.681: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:38:39.865: INFO @decay_lr : LR updated to `0.000118797994` 2019-11-15 19:38:39.867: INFO @log_profile : T train: 43.071991 2019-11-15 19:38:39.867: INFO @log_profile : T valid: 1.328148 2019-11-15 19:38:39.867: INFO @log_profile : T read data: 33.208783 2019-11-15 19:38:39.867: INFO @log_profile : T hooks: 101.407374 2019-11-15 19:38:39.867: INFO @main_loop : Epoch 425 done 2019-11-15 19:38:39.867: INFO @main_loop : Training epoch 426 2019-11-15 19:40:04.094: INFO @log_variables: train loss nanmean: 0.034297 2019-11-15 19:40:04.094: INFO @log_variables: train positive_distance nanmean: 0.554573 2019-11-15 19:40:04.094: INFO @log_variables: train negative_distance nanmean: 1.419419 2019-11-15 19:40:04.094: INFO @log_variables: valid loss nanmean: 0.274953 2019-11-15 19:40:04.094: INFO @log_variables: valid positive_distance nanmean: 0.678440 2019-11-15 19:40:04.094: INFO @log_variables: valid negative_distance nanmean: 1.400043 2019-11-15 19:40:04.094: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:41:38.927: INFO @metrics_hook: train matching accuracy: 0.9920789930555556, N=110592, DB_SIZE=110592, N_IDS=7300 2019-11-15 19:41:39.764: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:41:39.924: INFO @evaluate_embedding: best threshold 1.039241701364517 2019-11-15 19:41:39.993: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:41:39.993: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:41:40.196: INFO @decay_lr : LR updated to `0.00011820401` 2019-11-15 19:41:40.197: INFO @log_profile : T train: 42.837763 2019-11-15 19:41:40.197: INFO @log_profile : T valid: 1.290482 2019-11-15 19:41:40.197: INFO @log_profile : T read data: 35.126754 2019-11-15 19:41:40.197: INFO @log_profile : T hooks: 101.007386 2019-11-15 19:41:40.198: INFO @main_loop : Epoch 426 done 2019-11-15 19:41:40.198: INFO @main_loop : Training epoch 427 2019-11-15 19:43:05.118: INFO @log_variables: train loss nanmean: 0.033065 2019-11-15 19:43:05.119: INFO @log_variables: train positive_distance nanmean: 0.553741 2019-11-15 19:43:05.119: INFO @log_variables: train negative_distance nanmean: 1.419434 2019-11-15 19:43:05.119: INFO @log_variables: valid loss nanmean: 0.271981 2019-11-15 19:43:05.119: INFO @log_variables: valid positive_distance nanmean: 0.679513 2019-11-15 19:43:05.119: INFO @log_variables: valid negative_distance nanmean: 1.400678 2019-11-15 19:43:05.119: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:44:39.477: INFO @metrics_hook: train matching accuracy: 0.9914641203703703, N=110592, DB_SIZE=110592, N_IDS=7316 2019-11-15 19:44:40.240: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:44:40.400: INFO @evaluate_embedding: best threshold 1.040095120668411 2019-11-15 19:44:40.468: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:44:40.468: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:44:40.656: INFO @decay_lr : LR updated to `0.00011761299` 2019-11-15 19:44:40.657: INFO @log_profile : T train: 43.003505 2019-11-15 19:44:40.657: INFO @log_profile : T valid: 1.292683 2019-11-15 19:44:40.657: INFO @log_profile : T read data: 35.704502 2019-11-15 19:44:40.657: INFO @log_profile : T hooks: 100.390923 2019-11-15 19:44:40.657: INFO @main_loop : Epoch 427 done 2019-11-15 19:44:40.658: INFO @main_loop : Training epoch 428 2019-11-15 19:46:04.890: INFO @log_variables: train loss nanmean: 0.032357 2019-11-15 19:46:04.890: INFO @log_variables: train positive_distance nanmean: 0.553824 2019-11-15 19:46:04.890: INFO @log_variables: train negative_distance nanmean: 1.419437 2019-11-15 19:46:04.890: INFO @log_variables: valid loss nanmean: 0.272963 2019-11-15 19:46:04.890: INFO @log_variables: valid positive_distance nanmean: 0.679402 2019-11-15 19:46:04.890: INFO @log_variables: valid negative_distance nanmean: 1.400663 2019-11-15 19:46:04.890: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:47:39.452: INFO @metrics_hook: train matching accuracy: 0.9922417534722222, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-15 19:47:40.204: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:47:40.362: INFO @evaluate_embedding: best threshold 1.0400325953960419 2019-11-15 19:47:40.425: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:47:40.425: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:47:40.601: INFO @decay_lr : LR updated to `0.00011702492` 2019-11-15 19:47:40.603: INFO @log_profile : T train: 42.779498 2019-11-15 19:47:40.603: INFO @log_profile : T valid: 1.294306 2019-11-15 19:47:40.603: INFO @log_profile : T read data: 34.905878 2019-11-15 19:47:40.603: INFO @log_profile : T hooks: 100.897793 2019-11-15 19:47:40.603: INFO @main_loop : Epoch 428 done 2019-11-15 19:47:40.603: INFO @main_loop : Training epoch 429 2019-11-15 19:49:05.244: INFO @log_variables: train loss nanmean: 0.033336 2019-11-15 19:49:05.244: INFO @log_variables: train positive_distance nanmean: 0.553589 2019-11-15 19:49:05.244: INFO @log_variables: train negative_distance nanmean: 1.419449 2019-11-15 19:49:05.244: INFO @log_variables: valid loss nanmean: 0.272737 2019-11-15 19:49:05.245: INFO @log_variables: valid positive_distance nanmean: 0.678929 2019-11-15 19:49:05.245: INFO @log_variables: valid negative_distance nanmean: 1.400667 2019-11-15 19:49:05.245: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:50:38.934: INFO @metrics_hook: train matching accuracy: 0.9929380063657407, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 19:50:39.926: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:50:40.091: INFO @evaluate_embedding: best threshold 1.0397980213165283 2019-11-15 19:50:40.160: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:50:40.161: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:50:40.335: INFO @decay_lr : LR updated to `0.0001164398` 2019-11-15 19:50:40.337: INFO @log_profile : T train: 43.086863 2019-11-15 19:50:40.337: INFO @log_profile : T valid: 1.298719 2019-11-15 19:50:40.337: INFO @log_profile : T read data: 35.256753 2019-11-15 19:50:40.337: INFO @log_profile : T hooks: 100.022757 2019-11-15 19:50:40.337: INFO @main_loop : Epoch 429 done 2019-11-15 19:50:40.337: INFO @main_loop : Training epoch 430 2019-11-15 19:52:06.997: INFO @log_variables: train loss nanmean: 0.032652 2019-11-15 19:52:06.998: INFO @log_variables: train positive_distance nanmean: 0.553111 2019-11-15 19:52:06.998: INFO @log_variables: train negative_distance nanmean: 1.419435 2019-11-15 19:52:06.998: INFO @log_variables: valid loss nanmean: 0.272943 2019-11-15 19:52:06.998: INFO @log_variables: valid positive_distance nanmean: 0.678041 2019-11-15 19:52:06.998: INFO @log_variables: valid negative_distance nanmean: 1.400490 2019-11-15 19:52:06.998: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:53:42.582: INFO @metrics_hook: train matching accuracy: 0.99325442395855, N=110591, DB_SIZE=110592, N_IDS=7310 2019-11-15 19:53:43.490: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:53:43.658: INFO @evaluate_embedding: best threshold 1.0392653644084928 2019-11-15 19:53:43.727: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:53:43.727: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:53:43.931: INFO @decay_lr : LR updated to `0.0001158576` 2019-11-15 19:53:43.932: INFO @log_profile : T train: 42.873317 2019-11-15 19:53:43.932: INFO @log_profile : T valid: 1.305105 2019-11-15 19:53:43.932: INFO @log_profile : T read data: 37.267504 2019-11-15 19:53:43.932: INFO @log_profile : T hooks: 102.079327 2019-11-15 19:53:43.932: INFO @main_loop : Epoch 430 done 2019-11-15 19:53:43.933: INFO @main_loop : Training epoch 431 2019-11-15 19:55:07.586: INFO @log_variables: train loss nanmean: 0.033954 2019-11-15 19:55:07.586: INFO @log_variables: train positive_distance nanmean: 0.554287 2019-11-15 19:55:07.586: INFO @log_variables: train negative_distance nanmean: 1.419429 2019-11-15 19:55:07.586: INFO @log_variables: valid loss nanmean: 0.272578 2019-11-15 19:55:07.586: INFO @log_variables: valid positive_distance nanmean: 0.678281 2019-11-15 19:55:07.586: INFO @log_variables: valid negative_distance nanmean: 1.400387 2019-11-15 19:55:07.586: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:56:41.552: INFO @metrics_hook: train matching accuracy: 0.9924225298622854, N=110591, DB_SIZE=110592, N_IDS=7313 2019-11-15 19:56:42.443: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:56:42.607: INFO @evaluate_embedding: best threshold 1.0393339395523071 2019-11-15 19:56:42.669: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:56:42.669: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:56:42.857: INFO @decay_lr : LR updated to `0.00011527831` 2019-11-15 19:56:42.858: INFO @log_profile : T train: 43.635280 2019-11-15 19:56:42.858: INFO @log_profile : T valid: 1.298499 2019-11-15 19:56:42.858: INFO @log_profile : T read data: 33.438445 2019-11-15 19:56:42.858: INFO @log_profile : T hooks: 100.485286 2019-11-15 19:56:42.858: INFO @main_loop : Epoch 431 done 2019-11-15 19:56:42.858: INFO @main_loop : Training epoch 432 2019-11-15 19:58:08.237: INFO @log_variables: train loss nanmean: 0.033256 2019-11-15 19:58:08.238: INFO @log_variables: train positive_distance nanmean: 0.554709 2019-11-15 19:58:08.238: INFO @log_variables: train negative_distance nanmean: 1.419453 2019-11-15 19:58:08.238: INFO @log_variables: valid loss nanmean: 0.271715 2019-11-15 19:58:08.238: INFO @log_variables: valid positive_distance nanmean: 0.679097 2019-11-15 19:58:08.238: INFO @log_variables: valid negative_distance nanmean: 1.400605 2019-11-15 19:58:08.238: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 19:59:42.838: INFO @metrics_hook: train matching accuracy: 0.9922146267361112, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-15 19:59:43.802: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 19:59:43.978: INFO @evaluate_embedding: best threshold 1.0398508012294772 2019-11-15 19:59:44.050: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 19:59:44.051: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 19:59:44.243: INFO @decay_lr : LR updated to `0.000114701914` 2019-11-15 19:59:44.244: INFO @log_profile : T train: 42.713998 2019-11-15 19:59:44.244: INFO @log_profile : T valid: 1.294225 2019-11-15 19:59:44.244: INFO @log_profile : T read data: 36.134417 2019-11-15 19:59:44.245: INFO @log_profile : T hooks: 101.176725 2019-11-15 19:59:44.245: INFO @main_loop : Epoch 432 done 2019-11-15 19:59:44.245: INFO @main_loop : Training epoch 433 2019-11-15 20:01:10.366: INFO @log_variables: train loss nanmean: 0.032751 2019-11-15 20:01:10.366: INFO @log_variables: train positive_distance nanmean: 0.553621 2019-11-15 20:01:10.366: INFO @log_variables: train negative_distance nanmean: 1.419443 2019-11-15 20:01:10.366: INFO @log_variables: valid loss nanmean: 0.273226 2019-11-15 20:01:10.366: INFO @log_variables: valid positive_distance nanmean: 0.678829 2019-11-15 20:01:10.366: INFO @log_variables: valid negative_distance nanmean: 1.400689 2019-11-15 20:01:10.366: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:02:44.712: INFO @metrics_hook: train matching accuracy: 0.9919432865242199, N=110591, DB_SIZE=110592, N_IDS=7313 2019-11-15 20:02:45.763: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:02:45.913: INFO @evaluate_embedding: best threshold 1.0397591590881348 2019-11-15 20:02:45.985: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:02:45.986: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:02:46.176: INFO @decay_lr : LR updated to `0.0001141284` 2019-11-15 20:02:46.178: INFO @log_profile : T train: 42.735852 2019-11-15 20:02:46.178: INFO @log_profile : T valid: 1.304153 2019-11-15 20:02:46.178: INFO @log_profile : T read data: 36.908097 2019-11-15 20:02:46.178: INFO @log_profile : T hooks: 100.917120 2019-11-15 20:02:46.178: INFO @main_loop : Epoch 433 done 2019-11-15 20:02:46.178: INFO @main_loop : Training epoch 434 2019-11-15 20:04:11.085: INFO @log_variables: train loss nanmean: 0.032734 2019-11-15 20:04:11.085: INFO @log_variables: train positive_distance nanmean: 0.553186 2019-11-15 20:04:11.085: INFO @log_variables: train negative_distance nanmean: 1.419440 2019-11-15 20:04:11.086: INFO @log_variables: valid loss nanmean: 0.272956 2019-11-15 20:04:11.086: INFO @log_variables: valid positive_distance nanmean: 0.678903 2019-11-15 20:04:11.086: INFO @log_variables: valid negative_distance nanmean: 1.400547 2019-11-15 20:04:11.086: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:05:41.876: INFO @metrics_hook: train matching accuracy: 0.9923773871527778, N=110592, DB_SIZE=110592, N_IDS=7307 2019-11-15 20:05:42.780: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:05:42.958: INFO @evaluate_embedding: best threshold 1.0397250354290009 2019-11-15 20:05:43.036: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:05:43.036: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:05:43.210: INFO @decay_lr : LR updated to `0.00011355776` 2019-11-15 20:05:43.212: INFO @log_profile : T train: 43.436029 2019-11-15 20:05:43.212: INFO @log_profile : T valid: 1.301086 2019-11-15 20:05:43.212: INFO @log_profile : T read data: 35.401145 2019-11-15 20:05:43.212: INFO @log_profile : T hooks: 96.827719 2019-11-15 20:05:43.212: INFO @main_loop : Epoch 434 done 2019-11-15 20:05:43.212: INFO @main_loop : Training epoch 435 2019-11-15 20:07:09.715: INFO @log_variables: train loss nanmean: 0.033245 2019-11-15 20:07:09.715: INFO @log_variables: train positive_distance nanmean: 0.554054 2019-11-15 20:07:09.715: INFO @log_variables: train negative_distance nanmean: 1.419449 2019-11-15 20:07:09.715: INFO @log_variables: valid loss nanmean: 0.272125 2019-11-15 20:07:09.715: INFO @log_variables: valid positive_distance nanmean: 0.676966 2019-11-15 20:07:09.715: INFO @log_variables: valid negative_distance nanmean: 1.400792 2019-11-15 20:07:09.715: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:08:44.741: INFO @metrics_hook: train matching accuracy: 0.9926576967592593, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 20:08:45.716: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:08:45.871: INFO @evaluate_embedding: best threshold 1.0388790369033816 2019-11-15 20:08:45.943: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:08:45.943: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:08:46.123: INFO @decay_lr : LR updated to `0.000112989976` 2019-11-15 20:08:46.125: INFO @log_profile : T train: 42.759452 2019-11-15 20:08:46.125: INFO @log_profile : T valid: 1.301147 2019-11-15 20:08:46.126: INFO @log_profile : T read data: 37.259736 2019-11-15 20:08:46.126: INFO @log_profile : T hooks: 101.525234 2019-11-15 20:08:46.126: INFO @main_loop : Epoch 435 done 2019-11-15 20:08:46.126: INFO @main_loop : Training epoch 436 2019-11-15 20:10:11.615: INFO @log_variables: train loss nanmean: 0.035040 2019-11-15 20:10:11.615: INFO @log_variables: train positive_distance nanmean: 0.554717 2019-11-15 20:10:11.615: INFO @log_variables: train negative_distance nanmean: 1.419432 2019-11-15 20:10:11.615: INFO @log_variables: valid loss nanmean: 0.272900 2019-11-15 20:10:11.615: INFO @log_variables: valid positive_distance nanmean: 0.680006 2019-11-15 20:10:11.615: INFO @log_variables: valid negative_distance nanmean: 1.401072 2019-11-15 20:10:11.615: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:11:43.631: INFO @metrics_hook: train matching accuracy: 0.9924677414979519, N=110591, DB_SIZE=110592, N_IDS=7316 2019-11-15 20:11:44.374: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:11:44.532: INFO @evaluate_embedding: best threshold 1.0405390858650205 2019-11-15 20:11:44.606: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:11:44.606: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:11:44.776: INFO @decay_lr : LR updated to `0.00011242503` 2019-11-15 20:11:44.777: INFO @log_profile : T train: 44.400787 2019-11-15 20:11:44.777: INFO @log_profile : T valid: 1.389764 2019-11-15 20:11:44.777: INFO @log_profile : T read data: 34.567660 2019-11-15 20:11:44.777: INFO @log_profile : T hooks: 98.224830 2019-11-15 20:11:44.778: INFO @main_loop : Epoch 436 done 2019-11-15 20:11:44.778: INFO @main_loop : Training epoch 437 2019-11-15 20:13:07.424: INFO @log_variables: train loss nanmean: 0.033737 2019-11-15 20:13:07.424: INFO @log_variables: train positive_distance nanmean: 0.554122 2019-11-15 20:13:07.424: INFO @log_variables: train negative_distance nanmean: 1.419442 2019-11-15 20:13:07.424: INFO @log_variables: valid loss nanmean: 0.270960 2019-11-15 20:13:07.424: INFO @log_variables: valid positive_distance nanmean: 0.679377 2019-11-15 20:13:07.424: INFO @log_variables: valid negative_distance nanmean: 1.400964 2019-11-15 20:13:07.424: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:14:41.845: INFO @metrics_hook: train matching accuracy: 0.9922960069444444, N=110592, DB_SIZE=110592, N_IDS=7307 2019-11-15 20:14:42.651: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:14:42.800: INFO @evaluate_embedding: best threshold 1.0401705503463745 2019-11-15 20:14:42.864: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:14:42.865: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:14:43.049: INFO @decay_lr : LR updated to `0.0001118629` 2019-11-15 20:14:43.051: INFO @log_profile : T train: 43.393371 2019-11-15 20:14:43.051: INFO @log_profile : T valid: 1.320653 2019-11-15 20:14:43.051: INFO @log_profile : T read data: 32.714858 2019-11-15 20:14:43.051: INFO @log_profile : T hooks: 100.774227 2019-11-15 20:14:43.051: INFO @main_loop : Epoch 437 done 2019-11-15 20:14:43.051: INFO @main_loop : Training epoch 438 2019-11-15 20:16:08.606: INFO @log_variables: train loss nanmean: 0.033090 2019-11-15 20:16:08.606: INFO @log_variables: train positive_distance nanmean: 0.553927 2019-11-15 20:16:08.606: INFO @log_variables: train negative_distance nanmean: 1.419454 2019-11-15 20:16:08.606: INFO @log_variables: valid loss nanmean: 0.271118 2019-11-15 20:16:08.606: INFO @log_variables: valid positive_distance nanmean: 0.679754 2019-11-15 20:16:08.606: INFO @log_variables: valid negative_distance nanmean: 1.401027 2019-11-15 20:16:08.606: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:17:43.482: INFO @metrics_hook: train matching accuracy: 0.9928656038918175, N=110591, DB_SIZE=110592, N_IDS=7313 2019-11-15 20:17:44.400: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:17:44.563: INFO @evaluate_embedding: best threshold 1.0403905510902407 2019-11-15 20:17:44.625: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:17:44.625: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:17:44.815: INFO @decay_lr : LR updated to `0.00011130358` 2019-11-15 20:17:44.816: INFO @log_profile : T train: 44.308322 2019-11-15 20:17:44.816: INFO @log_profile : T valid: 1.424873 2019-11-15 20:17:44.816: INFO @log_profile : T read data: 34.733979 2019-11-15 20:17:44.817: INFO @log_profile : T hooks: 101.229718 2019-11-15 20:17:44.817: INFO @main_loop : Epoch 438 done 2019-11-15 20:17:44.817: INFO @main_loop : Training epoch 439 2019-11-15 20:19:09.440: INFO @log_variables: train loss nanmean: 0.032400 2019-11-15 20:19:09.440: INFO @log_variables: train positive_distance nanmean: 0.553954 2019-11-15 20:19:09.440: INFO @log_variables: train negative_distance nanmean: 1.419421 2019-11-15 20:19:09.440: INFO @log_variables: valid loss nanmean: 0.271706 2019-11-15 20:19:09.441: INFO @log_variables: valid positive_distance nanmean: 0.679384 2019-11-15 20:19:09.441: INFO @log_variables: valid negative_distance nanmean: 1.400814 2019-11-15 20:19:09.441: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:20:44.250: INFO @metrics_hook: train matching accuracy: 0.9925762494235516, N=110591, DB_SIZE=110592, N_IDS=7317 2019-11-15 20:20:45.174: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:20:45.333: INFO @evaluate_embedding: best threshold 1.0400987565517426 2019-11-15 20:20:45.396: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:20:45.397: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:20:45.569: INFO @decay_lr : LR updated to `0.00011074707` 2019-11-15 20:20:45.571: INFO @log_profile : T train: 46.006520 2019-11-15 20:20:45.571: INFO @log_profile : T valid: 1.407135 2019-11-15 20:20:45.571: INFO @log_profile : T read data: 32.155169 2019-11-15 20:20:45.571: INFO @log_profile : T hooks: 101.116424 2019-11-15 20:20:45.571: INFO @main_loop : Epoch 439 done 2019-11-15 20:20:45.571: INFO @main_loop : Training epoch 440 2019-11-15 20:22:10.162: INFO @log_variables: train loss nanmean: 0.032972 2019-11-15 20:22:10.162: INFO @log_variables: train positive_distance nanmean: 0.553875 2019-11-15 20:22:10.162: INFO @log_variables: train negative_distance nanmean: 1.419447 2019-11-15 20:22:10.162: INFO @log_variables: valid loss nanmean: 0.271792 2019-11-15 20:22:10.162: INFO @log_variables: valid positive_distance nanmean: 0.679757 2019-11-15 20:22:10.162: INFO @log_variables: valid negative_distance nanmean: 1.400498 2019-11-15 20:22:10.162: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:23:44.580: INFO @metrics_hook: train matching accuracy: 0.9918709479071534, N=110591, DB_SIZE=110592, N_IDS=7320 2019-11-15 20:23:45.439: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:23:45.617: INFO @evaluate_embedding: best threshold 1.0401273965835571 2019-11-15 20:23:45.680: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:23:45.681: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:23:45.863: INFO @decay_lr : LR updated to `0.00011019333` 2019-11-15 20:23:45.864: INFO @log_profile : T train: 46.924150 2019-11-15 20:23:45.864: INFO @log_profile : T valid: 1.300141 2019-11-15 20:23:45.864: INFO @log_profile : T read data: 31.157951 2019-11-15 20:23:45.865: INFO @log_profile : T hooks: 100.842758 2019-11-15 20:23:45.865: INFO @main_loop : Epoch 440 done 2019-11-15 20:23:45.865: INFO @main_loop : Training epoch 441 2019-11-15 20:25:12.875: INFO @log_variables: train loss nanmean: 0.033493 2019-11-15 20:25:12.875: INFO @log_variables: train positive_distance nanmean: 0.554738 2019-11-15 20:25:12.875: INFO @log_variables: train negative_distance nanmean: 1.419452 2019-11-15 20:25:12.875: INFO @log_variables: valid loss nanmean: 0.271788 2019-11-15 20:25:12.875: INFO @log_variables: valid positive_distance nanmean: 0.678996 2019-11-15 20:25:12.875: INFO @log_variables: valid negative_distance nanmean: 1.400730 2019-11-15 20:25:12.875: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:26:44.570: INFO @metrics_hook: train matching accuracy: 0.9927300347222222, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 20:26:45.351: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:26:45.514: INFO @evaluate_embedding: best threshold 1.0398628413677216 2019-11-15 20:26:45.592: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:26:45.592: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:26:45.771: INFO @decay_lr : LR updated to `0.000109642366` 2019-11-15 20:26:45.772: INFO @log_profile : T train: 45.956814 2019-11-15 20:26:45.772: INFO @log_profile : T valid: 1.442428 2019-11-15 20:26:45.772: INFO @log_profile : T read data: 34.556969 2019-11-15 20:26:45.773: INFO @log_profile : T hooks: 97.883424 2019-11-15 20:26:45.773: INFO @main_loop : Epoch 441 done 2019-11-15 20:26:45.773: INFO @main_loop : Training epoch 442 2019-11-15 20:28:11.509: INFO @log_variables: train loss nanmean: 0.031716 2019-11-15 20:28:11.510: INFO @log_variables: train positive_distance nanmean: 0.553201 2019-11-15 20:28:11.510: INFO @log_variables: train negative_distance nanmean: 1.419441 2019-11-15 20:28:11.510: INFO @log_variables: valid loss nanmean: 0.273390 2019-11-15 20:28:11.510: INFO @log_variables: valid positive_distance nanmean: 0.679758 2019-11-15 20:28:11.510: INFO @log_variables: valid negative_distance nanmean: 1.400559 2019-11-15 20:28:11.510: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:29:47.325: INFO @metrics_hook: train matching accuracy: 0.9925311053240741, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 20:29:48.356: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:29:48.519: INFO @evaluate_embedding: best threshold 1.0401588082313538 2019-11-15 20:29:48.584: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:29:48.585: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:29:48.767: INFO @decay_lr : LR updated to `0.00010909415` 2019-11-15 20:29:48.768: INFO @log_profile : T train: 49.292118 2019-11-15 20:29:48.768: INFO @log_profile : T valid: 1.411094 2019-11-15 20:29:48.768: INFO @log_profile : T read data: 30.050439 2019-11-15 20:29:48.768: INFO @log_profile : T hooks: 102.175453 2019-11-15 20:29:48.769: INFO @main_loop : Epoch 442 done 2019-11-15 20:29:48.769: INFO @main_loop : Training epoch 443 2019-11-15 20:31:14.008: INFO @log_variables: train loss nanmean: 0.033578 2019-11-15 20:31:14.008: INFO @log_variables: train positive_distance nanmean: 0.554190 2019-11-15 20:31:14.008: INFO @log_variables: train negative_distance nanmean: 1.419434 2019-11-15 20:31:14.009: INFO @log_variables: valid loss nanmean: 0.274556 2019-11-15 20:31:14.009: INFO @log_variables: valid positive_distance nanmean: 0.681429 2019-11-15 20:31:14.009: INFO @log_variables: valid negative_distance nanmean: 1.400849 2019-11-15 20:31:14.009: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:32:48.007: INFO @metrics_hook: train matching accuracy: 0.9928475839120371, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-15 20:32:48.749: INFO @metrics_hook: valid matching accuracy: 0.9878425935800362, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:32:48.909: INFO @evaluate_embedding: best threshold 1.0411392450332644 2019-11-15 20:32:48.972: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:32:48.972: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:32:49.139: INFO @decay_lr : LR updated to `0.00010854868` 2019-11-15 20:32:49.141: INFO @log_profile : T train: 48.579051 2019-11-15 20:32:49.141: INFO @log_profile : T valid: 1.305970 2019-11-15 20:32:49.141: INFO @log_profile : T read data: 30.132075 2019-11-15 20:32:49.141: INFO @log_profile : T hooks: 100.286870 2019-11-15 20:32:49.141: INFO @main_loop : Epoch 443 done 2019-11-15 20:32:49.141: INFO @main_loop : Training epoch 444 2019-11-15 20:34:14.566: INFO @log_variables: train loss nanmean: 0.033257 2019-11-15 20:34:14.567: INFO @log_variables: train positive_distance nanmean: 0.554253 2019-11-15 20:34:14.567: INFO @log_variables: train negative_distance nanmean: 1.419462 2019-11-15 20:34:14.567: INFO @log_variables: valid loss nanmean: 0.273733 2019-11-15 20:34:14.567: INFO @log_variables: valid positive_distance nanmean: 0.681029 2019-11-15 20:34:14.567: INFO @log_variables: valid negative_distance nanmean: 1.400702 2019-11-15 20:34:14.567: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:35:47.852: INFO @metrics_hook: train matching accuracy: 0.9921965422453703, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-15 20:35:48.688: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:35:48.877: INFO @evaluate_embedding: best threshold 1.0408655703067782 2019-11-15 20:35:48.945: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:35:48.945: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:35:49.120: INFO @decay_lr : LR updated to `0.00010800594` 2019-11-15 20:35:49.121: INFO @log_profile : T train: 46.206220 2019-11-15 20:35:49.122: INFO @log_profile : T valid: 1.410323 2019-11-15 20:35:49.122: INFO @log_profile : T read data: 32.858529 2019-11-15 20:35:49.122: INFO @log_profile : T hooks: 99.437712 2019-11-15 20:35:49.122: INFO @main_loop : Epoch 444 done 2019-11-15 20:35:49.122: INFO @main_loop : Training epoch 445 2019-11-15 20:37:16.132: INFO @log_variables: train loss nanmean: 0.032587 2019-11-15 20:37:16.132: INFO @log_variables: train positive_distance nanmean: 0.553808 2019-11-15 20:37:16.133: INFO @log_variables: train negative_distance nanmean: 1.419424 2019-11-15 20:37:16.133: INFO @log_variables: valid loss nanmean: 0.274430 2019-11-15 20:37:16.133: INFO @log_variables: valid positive_distance nanmean: 0.679842 2019-11-15 20:37:16.133: INFO @log_variables: valid negative_distance nanmean: 1.400681 2019-11-15 20:37:16.133: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:38:50.875: INFO @metrics_hook: train matching accuracy: 0.9922507256467524, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 20:38:51.695: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:38:51.880: INFO @evaluate_embedding: best threshold 1.0402614772319794 2019-11-15 20:38:51.948: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:38:51.948: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:38:52.136: INFO @decay_lr : LR updated to `0.00010746591` 2019-11-15 20:38:52.138: INFO @log_profile : T train: 45.277054 2019-11-15 20:38:52.138: INFO @log_profile : T valid: 1.422290 2019-11-15 20:38:52.138: INFO @log_profile : T read data: 35.305165 2019-11-15 20:38:52.138: INFO @log_profile : T hooks: 100.943848 2019-11-15 20:38:52.138: INFO @main_loop : Epoch 445 done 2019-11-15 20:38:52.138: INFO @main_loop : Training epoch 446 2019-11-15 20:40:15.835: INFO @log_variables: train loss nanmean: 0.033394 2019-11-15 20:40:15.836: INFO @log_variables: train positive_distance nanmean: 0.554346 2019-11-15 20:40:15.836: INFO @log_variables: train negative_distance nanmean: 1.419445 2019-11-15 20:40:15.836: INFO @log_variables: valid loss nanmean: 0.275612 2019-11-15 20:40:15.836: INFO @log_variables: valid positive_distance nanmean: 0.680579 2019-11-15 20:40:15.836: INFO @log_variables: valid negative_distance nanmean: 1.400617 2019-11-15 20:40:15.836: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:41:48.572: INFO @metrics_hook: train matching accuracy: 0.9921059770322814, N=110590, DB_SIZE=110592, N_IDS=7309 2019-11-15 20:41:49.460: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:41:49.623: INFO @evaluate_embedding: best threshold 1.040597945451737 2019-11-15 20:41:49.684: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:41:49.684: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:41:49.857: INFO @decay_lr : LR updated to `0.00010692858` 2019-11-15 20:41:49.859: INFO @log_profile : T train: 43.814367 2019-11-15 20:41:49.859: INFO @log_profile : T valid: 1.297978 2019-11-15 20:41:49.859: INFO @log_profile : T read data: 33.501695 2019-11-15 20:41:49.859: INFO @log_profile : T hooks: 99.037175 2019-11-15 20:41:49.859: INFO @main_loop : Epoch 446 done 2019-11-15 20:41:49.859: INFO @main_loop : Training epoch 447 2019-11-15 20:43:14.609: INFO @log_variables: train loss nanmean: 0.033385 2019-11-15 20:43:14.609: INFO @log_variables: train positive_distance nanmean: 0.554928 2019-11-15 20:43:14.609: INFO @log_variables: train negative_distance nanmean: 1.419441 2019-11-15 20:43:14.609: INFO @log_variables: valid loss nanmean: 0.273734 2019-11-15 20:43:14.609: INFO @log_variables: valid positive_distance nanmean: 0.678980 2019-11-15 20:43:14.609: INFO @log_variables: valid negative_distance nanmean: 1.400683 2019-11-15 20:43:14.609: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:44:48.773: INFO @metrics_hook: train matching accuracy: 0.9925763165509259, N=110592, DB_SIZE=110592, N_IDS=7310 2019-11-15 20:44:49.545: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:44:49.709: INFO @evaluate_embedding: best threshold 1.0398316979408264 2019-11-15 20:44:49.780: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:44:49.780: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:44:49.965: INFO @decay_lr : LR updated to `0.000106393934` 2019-11-15 20:44:49.966: INFO @log_profile : T train: 42.709886 2019-11-15 20:44:49.967: INFO @log_profile : T valid: 1.303118 2019-11-15 20:44:49.967: INFO @log_profile : T read data: 35.780947 2019-11-15 20:44:49.967: INFO @log_profile : T hooks: 100.243498 2019-11-15 20:44:49.967: INFO @main_loop : Epoch 447 done 2019-11-15 20:44:49.967: INFO @main_loop : Training epoch 448 2019-11-15 20:46:14.500: INFO @log_variables: train loss nanmean: 0.032465 2019-11-15 20:46:14.500: INFO @log_variables: train positive_distance nanmean: 0.553280 2019-11-15 20:46:14.500: INFO @log_variables: train negative_distance nanmean: 1.419437 2019-11-15 20:46:14.500: INFO @log_variables: valid loss nanmean: 0.273795 2019-11-15 20:46:14.500: INFO @log_variables: valid positive_distance nanmean: 0.680241 2019-11-15 20:46:14.500: INFO @log_variables: valid negative_distance nanmean: 1.400661 2019-11-15 20:46:14.500: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:47:48.939: INFO @metrics_hook: train matching accuracy: 0.9917442806763722, N=110590, DB_SIZE=110592, N_IDS=7314 2019-11-15 20:47:49.934: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:47:50.101: INFO @evaluate_embedding: best threshold 1.0404512286186216 2019-11-15 20:47:50.165: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:47:50.166: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:47:50.355: INFO @decay_lr : LR updated to `0.00010586197` 2019-11-15 20:47:50.356: INFO @log_profile : T train: 42.795435 2019-11-15 20:47:50.356: INFO @log_profile : T valid: 1.297744 2019-11-15 20:47:50.356: INFO @log_profile : T read data: 35.213470 2019-11-15 20:47:50.357: INFO @log_profile : T hooks: 101.015175 2019-11-15 20:47:50.357: INFO @main_loop : Epoch 448 done 2019-11-15 20:47:50.357: INFO @main_loop : Training epoch 449 2019-11-15 20:49:16.211: INFO @log_variables: train loss nanmean: 0.033051 2019-11-15 20:49:16.212: INFO @log_variables: train positive_distance nanmean: 0.553461 2019-11-15 20:49:16.212: INFO @log_variables: train negative_distance nanmean: 1.419455 2019-11-15 20:49:16.212: INFO @log_variables: valid loss nanmean: 0.274745 2019-11-15 20:49:16.212: INFO @log_variables: valid positive_distance nanmean: 0.680767 2019-11-15 20:49:16.212: INFO @log_variables: valid negative_distance nanmean: 1.400654 2019-11-15 20:49:16.212: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:50:52.066: INFO @metrics_hook: train matching accuracy: 0.9926486545138888, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 20:50:52.850: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:50:53.007: INFO @evaluate_embedding: best threshold 1.0407106280326843 2019-11-15 20:50:53.072: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:50:53.072: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:50:53.259: INFO @decay_lr : LR updated to `0.000105332656` 2019-11-15 20:50:53.261: INFO @log_profile : T train: 42.792496 2019-11-15 20:50:53.261: INFO @log_profile : T valid: 1.297538 2019-11-15 20:50:53.261: INFO @log_profile : T read data: 36.729690 2019-11-15 20:50:53.261: INFO @log_profile : T hooks: 102.015971 2019-11-15 20:50:53.261: INFO @main_loop : Epoch 449 done 2019-11-15 20:50:53.261: INFO @main_loop : Training epoch 450 2019-11-15 20:52:17.065: INFO @log_variables: train loss nanmean: 0.032063 2019-11-15 20:52:17.065: INFO @log_variables: train positive_distance nanmean: 0.553682 2019-11-15 20:52:17.066: INFO @log_variables: train negative_distance nanmean: 1.419445 2019-11-15 20:52:17.066: INFO @log_variables: valid loss nanmean: 0.274579 2019-11-15 20:52:17.066: INFO @log_variables: valid positive_distance nanmean: 0.680073 2019-11-15 20:52:17.066: INFO @log_variables: valid negative_distance nanmean: 1.400315 2019-11-15 20:52:17.066: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:53:50.596: INFO @metrics_hook: train matching accuracy: 0.9924315037525997, N=110590, DB_SIZE=110592, N_IDS=7317 2019-11-15 20:53:51.577: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:53:51.736: INFO @evaluate_embedding: best threshold 1.0401940643787384 2019-11-15 20:53:51.807: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:53:51.807: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:53:51.983: INFO @decay_lr : LR updated to `0.00010480599` 2019-11-15 20:53:51.984: INFO @log_profile : T train: 43.006848 2019-11-15 20:53:51.984: INFO @log_profile : T valid: 1.300349 2019-11-15 20:53:51.985: INFO @log_profile : T read data: 34.614729 2019-11-15 20:53:51.985: INFO @log_profile : T hooks: 99.734099 2019-11-15 20:53:51.985: INFO @main_loop : Epoch 450 done 2019-11-15 20:53:51.985: INFO @main_loop : Training epoch 451 2019-11-15 20:55:15.830: INFO @log_variables: train loss nanmean: 0.031801 2019-11-15 20:55:15.830: INFO @log_variables: train positive_distance nanmean: 0.553098 2019-11-15 20:55:15.830: INFO @log_variables: train negative_distance nanmean: 1.419433 2019-11-15 20:55:15.830: INFO @log_variables: valid loss nanmean: 0.275442 2019-11-15 20:55:15.830: INFO @log_variables: valid positive_distance nanmean: 0.679459 2019-11-15 20:55:15.830: INFO @log_variables: valid negative_distance nanmean: 1.400921 2019-11-15 20:55:15.830: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:56:50.695: INFO @metrics_hook: train matching accuracy: 0.9923140219366856, N=110591, DB_SIZE=110592, N_IDS=7320 2019-11-15 20:56:51.498: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:56:51.657: INFO @evaluate_embedding: best threshold 1.0401898622512817 2019-11-15 20:56:51.724: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:56:51.724: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:56:51.906: INFO @decay_lr : LR updated to `0.000104281964` 2019-11-15 20:56:51.907: INFO @log_profile : T train: 42.885793 2019-11-15 20:56:51.907: INFO @log_profile : T valid: 1.294929 2019-11-15 20:56:51.908: INFO @log_profile : T read data: 34.755041 2019-11-15 20:56:51.908: INFO @log_profile : T hooks: 100.920511 2019-11-15 20:56:51.908: INFO @main_loop : Epoch 451 done 2019-11-15 20:56:51.908: INFO @main_loop : Training epoch 452 2019-11-15 20:58:17.706: INFO @log_variables: train loss nanmean: 0.033199 2019-11-15 20:58:17.707: INFO @log_variables: train positive_distance nanmean: 0.554308 2019-11-15 20:58:17.707: INFO @log_variables: train negative_distance nanmean: 1.419450 2019-11-15 20:58:17.707: INFO @log_variables: valid loss nanmean: 0.274039 2019-11-15 20:58:17.707: INFO @log_variables: valid positive_distance nanmean: 0.679240 2019-11-15 20:58:17.707: INFO @log_variables: valid negative_distance nanmean: 1.400719 2019-11-15 20:58:17.707: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 20:59:51.345: INFO @metrics_hook: train matching accuracy: 0.9920789214312196, N=110591, DB_SIZE=110592, N_IDS=7316 2019-11-15 20:59:52.254: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 20:59:52.409: INFO @evaluate_embedding: best threshold 1.0399793386459348 2019-11-15 20:59:52.474: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 20:59:52.474: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 20:59:52.653: INFO @decay_lr : LR updated to `0.000103760554` 2019-11-15 20:59:52.654: INFO @log_profile : T train: 44.055845 2019-11-15 20:59:52.654: INFO @log_profile : T valid: 1.298530 2019-11-15 20:59:52.654: INFO @log_profile : T read data: 35.257268 2019-11-15 20:59:52.654: INFO @log_profile : T hooks: 100.067154 2019-11-15 20:59:52.655: INFO @main_loop : Epoch 452 done 2019-11-15 20:59:52.655: INFO @main_loop : Training epoch 453 2019-11-15 21:01:17.087: INFO @log_variables: train loss nanmean: 0.032782 2019-11-15 21:01:17.087: INFO @log_variables: train positive_distance nanmean: 0.553942 2019-11-15 21:01:17.087: INFO @log_variables: train negative_distance nanmean: 1.419433 2019-11-15 21:01:17.087: INFO @log_variables: valid loss nanmean: 0.273866 2019-11-15 21:01:17.088: INFO @log_variables: valid positive_distance nanmean: 0.681366 2019-11-15 21:01:17.088: INFO @log_variables: valid negative_distance nanmean: 1.401020 2019-11-15 21:01:17.088: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:02:50.105: INFO @metrics_hook: train matching accuracy: 0.9924135561342593, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 21:02:51.025: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:02:51.180: INFO @evaluate_embedding: best threshold 1.0411927700042725 2019-11-15 21:02:51.252: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:02:51.252: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:02:51.422: INFO @decay_lr : LR updated to `0.00010324175` 2019-11-15 21:02:51.424: INFO @log_profile : T train: 44.241818 2019-11-15 21:02:51.424: INFO @log_profile : T valid: 1.421703 2019-11-15 21:02:51.424: INFO @log_profile : T read data: 33.518268 2019-11-15 21:02:51.424: INFO @log_profile : T hooks: 99.519434 2019-11-15 21:02:51.424: INFO @main_loop : Epoch 453 done 2019-11-15 21:02:51.424: INFO @main_loop : Training epoch 454 2019-11-15 21:04:15.246: INFO @log_variables: train loss nanmean: 0.033359 2019-11-15 21:04:15.247: INFO @log_variables: train positive_distance nanmean: 0.553511 2019-11-15 21:04:15.247: INFO @log_variables: train negative_distance nanmean: 1.419430 2019-11-15 21:04:15.247: INFO @log_variables: valid loss nanmean: 0.273347 2019-11-15 21:04:15.247: INFO @log_variables: valid positive_distance nanmean: 0.680989 2019-11-15 21:04:15.247: INFO @log_variables: valid negative_distance nanmean: 1.400823 2019-11-15 21:04:15.247: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:05:49.672: INFO @metrics_hook: train matching accuracy: 0.9916901013644872, N=110591, DB_SIZE=110592, N_IDS=7314 2019-11-15 21:05:50.476: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:05:50.669: INFO @evaluate_embedding: best threshold 1.0409062504768372 2019-11-15 21:05:50.735: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:05:50.735: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:05:50.917: INFO @decay_lr : LR updated to `0.00010272554` 2019-11-15 21:05:50.918: INFO @log_profile : T train: 43.458162 2019-11-15 21:05:50.918: INFO @log_profile : T valid: 1.301997 2019-11-15 21:05:50.918: INFO @log_profile : T read data: 34.008403 2019-11-15 21:05:50.918: INFO @log_profile : T hooks: 100.655856 2019-11-15 21:05:50.918: INFO @main_loop : Epoch 454 done 2019-11-15 21:05:50.918: INFO @main_loop : Training epoch 455 2019-11-15 21:07:14.774: INFO @log_variables: train loss nanmean: 0.032553 2019-11-15 21:07:14.774: INFO @log_variables: train positive_distance nanmean: 0.553417 2019-11-15 21:07:14.774: INFO @log_variables: train negative_distance nanmean: 1.419440 2019-11-15 21:07:14.774: INFO @log_variables: valid loss nanmean: 0.273373 2019-11-15 21:07:14.774: INFO @log_variables: valid positive_distance nanmean: 0.680192 2019-11-15 21:07:14.774: INFO @log_variables: valid negative_distance nanmean: 1.400779 2019-11-15 21:07:14.774: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:08:47.512: INFO @metrics_hook: train matching accuracy: 0.9922235986653525, N=110591, DB_SIZE=110592, N_IDS=7311 2019-11-15 21:08:48.256: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:08:48.407: INFO @evaluate_embedding: best threshold 1.0404852926731112 2019-11-15 21:08:48.475: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:08:48.475: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:08:48.641: INFO @decay_lr : LR updated to `0.00010221192` 2019-11-15 21:08:48.642: INFO @log_profile : T train: 43.894541 2019-11-15 21:08:48.642: INFO @log_profile : T valid: 1.417079 2019-11-15 21:08:48.642: INFO @log_profile : T read data: 33.339299 2019-11-15 21:08:48.642: INFO @log_profile : T hooks: 99.005139 2019-11-15 21:08:48.642: INFO @main_loop : Epoch 455 done 2019-11-15 21:08:48.643: INFO @main_loop : Training epoch 456 2019-11-15 21:10:12.743: INFO @log_variables: train loss nanmean: 0.032434 2019-11-15 21:10:12.744: INFO @log_variables: train positive_distance nanmean: 0.553694 2019-11-15 21:10:12.744: INFO @log_variables: train negative_distance nanmean: 1.419443 2019-11-15 21:10:12.744: INFO @log_variables: valid loss nanmean: 0.272400 2019-11-15 21:10:12.744: INFO @log_variables: valid positive_distance nanmean: 0.679791 2019-11-15 21:10:12.744: INFO @log_variables: valid negative_distance nanmean: 1.401158 2019-11-15 21:10:12.744: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:11:48.315: INFO @metrics_hook: train matching accuracy: 0.9919343171296297, N=110592, DB_SIZE=110592, N_IDS=7305 2019-11-15 21:11:49.112: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:11:49.295: INFO @evaluate_embedding: best threshold 1.0404745936393738 2019-11-15 21:11:49.363: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:11:49.364: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:11:49.549: INFO @decay_lr : LR updated to `0.00010170086` 2019-11-15 21:11:49.550: INFO @log_profile : T train: 43.579923 2019-11-15 21:11:49.550: INFO @log_profile : T valid: 1.299768 2019-11-15 21:11:49.550: INFO @log_profile : T read data: 33.999460 2019-11-15 21:11:49.550: INFO @log_profile : T hooks: 101.961292 2019-11-15 21:11:49.551: INFO @main_loop : Epoch 456 done 2019-11-15 21:11:49.551: INFO @main_loop : Training epoch 457 2019-11-15 21:13:12.350: INFO @log_variables: train loss nanmean: 0.032330 2019-11-15 21:13:12.350: INFO @log_variables: train positive_distance nanmean: 0.553434 2019-11-15 21:13:12.350: INFO @log_variables: train negative_distance nanmean: 1.419445 2019-11-15 21:13:12.350: INFO @log_variables: valid loss nanmean: 0.271865 2019-11-15 21:13:12.350: INFO @log_variables: valid positive_distance nanmean: 0.681410 2019-11-15 21:13:12.350: INFO @log_variables: valid negative_distance nanmean: 1.401081 2019-11-15 21:13:12.350: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:14:45.029: INFO @metrics_hook: train matching accuracy: 0.9932815509399499, N=110591, DB_SIZE=110592, N_IDS=7315 2019-11-15 21:14:45.962: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:14:49.144: INFO @evaluate_embedding: best threshold 1.0412453114986422 2019-11-15 21:14:49.209: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:14:49.210: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:14:49.386: INFO @decay_lr : LR updated to `0.00010119236` 2019-11-15 21:14:49.388: INFO @log_profile : T train: 42.938219 2019-11-15 21:14:49.388: INFO @log_profile : T valid: 1.298231 2019-11-15 21:14:49.388: INFO @log_profile : T read data: 33.429114 2019-11-15 21:14:49.388: INFO @log_profile : T hooks: 102.103501 2019-11-15 21:14:49.388: INFO @main_loop : Epoch 457 done 2019-11-15 21:14:49.388: INFO @main_loop : Training epoch 458 2019-11-15 21:16:12.811: INFO @log_variables: train loss nanmean: 0.032694 2019-11-15 21:16:12.811: INFO @log_variables: train positive_distance nanmean: 0.554657 2019-11-15 21:16:12.811: INFO @log_variables: train negative_distance nanmean: 1.419450 2019-11-15 21:16:12.811: INFO @log_variables: valid loss nanmean: 0.273412 2019-11-15 21:16:12.811: INFO @log_variables: valid positive_distance nanmean: 0.678858 2019-11-15 21:16:12.811: INFO @log_variables: valid negative_distance nanmean: 1.400784 2019-11-15 21:16:12.811: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:17:47.521: INFO @metrics_hook: train matching accuracy: 0.9923773871527778, N=110592, DB_SIZE=110592, N_IDS=7307 2019-11-15 21:17:48.447: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:17:48.616: INFO @evaluate_embedding: best threshold 1.0398208796978 2019-11-15 21:17:48.682: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:17:48.683: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:17:48.866: INFO @decay_lr : LR updated to `0.0001006864` 2019-11-15 21:17:48.867: INFO @log_profile : T train: 42.753148 2019-11-15 21:17:48.867: INFO @log_profile : T valid: 1.326172 2019-11-15 21:17:48.867: INFO @log_profile : T read data: 34.090744 2019-11-15 21:17:48.867: INFO @log_profile : T hooks: 101.240591 2019-11-15 21:17:48.868: INFO @main_loop : Epoch 458 done 2019-11-15 21:17:48.868: INFO @main_loop : Training epoch 459 2019-11-15 21:19:13.102: INFO @log_variables: train loss nanmean: 0.031901 2019-11-15 21:19:13.102: INFO @log_variables: train positive_distance nanmean: 0.552747 2019-11-15 21:19:13.103: INFO @log_variables: train negative_distance nanmean: 1.419459 2019-11-15 21:19:13.103: INFO @log_variables: valid loss nanmean: 0.273554 2019-11-15 21:19:13.103: INFO @log_variables: valid positive_distance nanmean: 0.680257 2019-11-15 21:19:13.103: INFO @log_variables: valid negative_distance nanmean: 1.400867 2019-11-15 21:19:13.103: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:20:47.701: INFO @metrics_hook: train matching accuracy: 0.9920337818287037, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 21:20:48.434: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:20:48.630: INFO @evaluate_embedding: best threshold 1.0405621230602267 2019-11-15 21:20:48.691: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:20:48.691: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:20:48.881: INFO @decay_lr : LR updated to `0.000100182966` 2019-11-15 21:20:48.882: INFO @log_profile : T train: 44.037159 2019-11-15 21:20:48.882: INFO @log_profile : T valid: 1.415923 2019-11-15 21:20:48.882: INFO @log_profile : T read data: 33.850296 2019-11-15 21:20:48.882: INFO @log_profile : T hooks: 100.642504 2019-11-15 21:20:48.882: INFO @main_loop : Epoch 459 done 2019-11-15 21:20:48.882: INFO @main_loop : Training epoch 460 2019-11-15 21:22:13.948: INFO @log_variables: train loss nanmean: 0.033921 2019-11-15 21:22:13.949: INFO @log_variables: train positive_distance nanmean: 0.553647 2019-11-15 21:22:13.949: INFO @log_variables: train negative_distance nanmean: 1.419448 2019-11-15 21:22:13.949: INFO @log_variables: valid loss nanmean: 0.272429 2019-11-15 21:22:13.949: INFO @log_variables: valid positive_distance nanmean: 0.679984 2019-11-15 21:22:13.949: INFO @log_variables: valid negative_distance nanmean: 1.400871 2019-11-15 21:22:13.949: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:23:47.550: INFO @metrics_hook: train matching accuracy: 0.991943359375, N=110592, DB_SIZE=110592, N_IDS=7302 2019-11-15 21:23:48.316: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:23:48.468: INFO @evaluate_embedding: best threshold 1.0404275953769684 2019-11-15 21:23:48.531: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:23:48.531: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:23:48.728: INFO @decay_lr : LR updated to `9.968205e-05` 2019-11-15 21:23:48.729: INFO @log_profile : T train: 43.532353 2019-11-15 21:23:48.729: INFO @log_profile : T valid: 1.405189 2019-11-15 21:23:48.730: INFO @log_profile : T read data: 34.828140 2019-11-15 21:23:48.730: INFO @log_profile : T hooks: 100.011399 2019-11-15 21:23:48.730: INFO @main_loop : Epoch 460 done 2019-11-15 21:23:48.730: INFO @main_loop : Training epoch 461 2019-11-15 21:25:11.706: INFO @log_variables: train loss nanmean: 0.031933 2019-11-15 21:25:11.706: INFO @log_variables: train positive_distance nanmean: 0.553971 2019-11-15 21:25:11.707: INFO @log_variables: train negative_distance nanmean: 1.419461 2019-11-15 21:25:11.707: INFO @log_variables: valid loss nanmean: 0.272883 2019-11-15 21:25:11.707: INFO @log_variables: valid positive_distance nanmean: 0.680128 2019-11-15 21:25:11.707: INFO @log_variables: valid negative_distance nanmean: 1.400786 2019-11-15 21:25:11.707: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:26:45.954: INFO @metrics_hook: train matching accuracy: 0.9924949363425926, N=110592, DB_SIZE=110592, N_IDS=7322 2019-11-15 21:26:46.838: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:26:46.992: INFO @evaluate_embedding: best threshold 1.040457010269165 2019-11-15 21:26:47.056: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:26:47.056: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:26:47.233: INFO @decay_lr : LR updated to `9.918364e-05` 2019-11-15 21:26:47.234: INFO @log_profile : T train: 43.284777 2019-11-15 21:26:47.234: INFO @log_profile : T valid: 1.289095 2019-11-15 21:26:47.234: INFO @log_profile : T read data: 33.526232 2019-11-15 21:26:47.234: INFO @log_profile : T hooks: 100.335449 2019-11-15 21:26:47.234: INFO @main_loop : Epoch 461 done 2019-11-15 21:26:47.234: INFO @main_loop : Training epoch 462 2019-11-15 21:28:11.318: INFO @log_variables: train loss nanmean: 0.033626 2019-11-15 21:28:11.318: INFO @log_variables: train positive_distance nanmean: 0.554119 2019-11-15 21:28:11.318: INFO @log_variables: train negative_distance nanmean: 1.419443 2019-11-15 21:28:11.318: INFO @log_variables: valid loss nanmean: 0.274642 2019-11-15 21:28:11.318: INFO @log_variables: valid positive_distance nanmean: 0.680793 2019-11-15 21:28:11.318: INFO @log_variables: valid negative_distance nanmean: 1.400550 2019-11-15 21:28:11.318: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:29:45.954: INFO @metrics_hook: train matching accuracy: 0.9919524016203703, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 21:29:46.853: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:29:47.020: INFO @evaluate_embedding: best threshold 1.0406718254089353 2019-11-15 21:29:47.081: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:29:47.081: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:29:47.274: INFO @decay_lr : LR updated to `9.868773e-05` 2019-11-15 21:29:47.276: INFO @log_profile : T train: 42.892702 2019-11-15 21:29:47.276: INFO @log_profile : T valid: 1.296345 2019-11-15 21:29:47.276: INFO @log_profile : T read data: 34.734406 2019-11-15 21:29:47.276: INFO @log_profile : T hooks: 101.049426 2019-11-15 21:29:47.276: INFO @main_loop : Epoch 462 done 2019-11-15 21:29:47.276: INFO @main_loop : Training epoch 463 2019-11-15 21:31:12.475: INFO @log_variables: train loss nanmean: 0.032384 2019-11-15 21:31:12.475: INFO @log_variables: train positive_distance nanmean: 0.553398 2019-11-15 21:31:12.475: INFO @log_variables: train negative_distance nanmean: 1.419449 2019-11-15 21:31:12.475: INFO @log_variables: valid loss nanmean: 0.272624 2019-11-15 21:31:12.475: INFO @log_variables: valid positive_distance nanmean: 0.679878 2019-11-15 21:31:12.475: INFO @log_variables: valid negative_distance nanmean: 1.401050 2019-11-15 21:31:12.475: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:32:46.629: INFO @metrics_hook: train matching accuracy: 0.992440614516552, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 21:32:47.477: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:32:47.637: INFO @evaluate_embedding: best threshold 1.0404640436172485 2019-11-15 21:32:47.699: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:32:47.699: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:32:47.901: INFO @decay_lr : LR updated to `9.819429e-05` 2019-11-15 21:32:47.902: INFO @log_profile : T train: 43.579315 2019-11-15 21:32:47.902: INFO @log_profile : T valid: 1.300500 2019-11-15 21:32:47.902: INFO @log_profile : T read data: 35.218612 2019-11-15 21:32:47.902: INFO @log_profile : T hooks: 100.460556 2019-11-15 21:32:47.902: INFO @main_loop : Epoch 463 done 2019-11-15 21:32:47.903: INFO @main_loop : Training epoch 464 2019-11-15 21:34:11.807: INFO @log_variables: train loss nanmean: 0.032344 2019-11-15 21:34:11.807: INFO @log_variables: train positive_distance nanmean: 0.553592 2019-11-15 21:34:11.807: INFO @log_variables: train negative_distance nanmean: 1.419457 2019-11-15 21:34:11.807: INFO @log_variables: valid loss nanmean: 0.273026 2019-11-15 21:34:11.807: INFO @log_variables: valid positive_distance nanmean: 0.678937 2019-11-15 21:34:11.807: INFO @log_variables: valid negative_distance nanmean: 1.400703 2019-11-15 21:34:11.808: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:35:47.165: INFO @metrics_hook: train matching accuracy: 0.9925763165509259, N=110592, DB_SIZE=110592, N_IDS=7307 2019-11-15 21:35:48.073: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:35:48.225: INFO @evaluate_embedding: best threshold 1.03982013463974 2019-11-15 21:35:48.288: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:35:48.288: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:35:48.465: INFO @decay_lr : LR updated to `9.770331e-05` 2019-11-15 21:35:48.466: INFO @log_profile : T train: 44.066442 2019-11-15 21:35:48.466: INFO @log_profile : T valid: 1.300676 2019-11-15 21:35:48.466: INFO @log_profile : T read data: 33.628171 2019-11-15 21:35:48.466: INFO @log_profile : T hooks: 101.501123 2019-11-15 21:35:48.467: INFO @main_loop : Epoch 464 done 2019-11-15 21:35:48.467: INFO @main_loop : Training epoch 465 2019-11-15 21:37:14.532: INFO @log_variables: train loss nanmean: 0.031131 2019-11-15 21:37:14.533: INFO @log_variables: train positive_distance nanmean: 0.552510 2019-11-15 21:37:14.533: INFO @log_variables: train negative_distance nanmean: 1.419456 2019-11-15 21:37:14.533: INFO @log_variables: valid loss nanmean: 0.273018 2019-11-15 21:37:14.533: INFO @log_variables: valid positive_distance nanmean: 0.680500 2019-11-15 21:37:14.533: INFO @log_variables: valid negative_distance nanmean: 1.400778 2019-11-15 21:37:14.533: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:38:48.551: INFO @metrics_hook: train matching accuracy: 0.9920518663194444, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-15 21:38:49.360: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:38:49.510: INFO @evaluate_embedding: best threshold 1.0406391024589539 2019-11-15 21:38:49.597: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:38:49.597: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:38:49.792: INFO @decay_lr : LR updated to `9.72148e-05` 2019-11-15 21:38:49.793: INFO @log_profile : T train: 43.305464 2019-11-15 21:38:49.793: INFO @log_profile : T valid: 1.297949 2019-11-15 21:38:49.793: INFO @log_profile : T read data: 36.451578 2019-11-15 21:38:49.793: INFO @log_profile : T hooks: 100.201396 2019-11-15 21:38:49.793: INFO @main_loop : Epoch 465 done 2019-11-15 21:38:49.793: INFO @main_loop : Training epoch 466 2019-11-15 21:40:12.796: INFO @log_variables: train loss nanmean: 0.031539 2019-11-15 21:40:12.797: INFO @log_variables: train positive_distance nanmean: 0.553374 2019-11-15 21:40:12.797: INFO @log_variables: train negative_distance nanmean: 1.419460 2019-11-15 21:40:12.797: INFO @log_variables: valid loss nanmean: 0.273163 2019-11-15 21:40:12.797: INFO @log_variables: valid positive_distance nanmean: 0.680495 2019-11-15 21:40:12.797: INFO @log_variables: valid negative_distance nanmean: 1.400585 2019-11-15 21:40:12.797: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:41:46.345: INFO @metrics_hook: train matching accuracy: 0.99267578125, N=110592, DB_SIZE=110592, N_IDS=7312 2019-11-15 21:41:47.184: INFO @metrics_hook: valid matching accuracy: 0.9865628665884612, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:41:47.345: INFO @evaluate_embedding: best threshold 1.0405398607254028 2019-11-15 21:41:47.416: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:41:47.416: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:41:47.600: INFO @decay_lr : LR updated to `9.672872e-05` 2019-11-15 21:41:47.601: INFO @log_profile : T train: 42.909518 2019-11-15 21:41:47.601: INFO @log_profile : T valid: 1.301414 2019-11-15 21:41:47.601: INFO @log_profile : T read data: 33.865484 2019-11-15 21:41:47.601: INFO @log_profile : T hooks: 99.662951 2019-11-15 21:41:47.601: INFO @main_loop : Epoch 466 done 2019-11-15 21:41:47.601: INFO @main_loop : Training epoch 467 2019-11-15 21:43:13.622: INFO @log_variables: train loss nanmean: 0.032880 2019-11-15 21:43:13.623: INFO @log_variables: train positive_distance nanmean: 0.554097 2019-11-15 21:43:13.623: INFO @log_variables: train negative_distance nanmean: 1.419459 2019-11-15 21:43:13.623: INFO @log_variables: valid loss nanmean: 0.274694 2019-11-15 21:43:13.623: INFO @log_variables: valid positive_distance nanmean: 0.680593 2019-11-15 21:43:13.623: INFO @log_variables: valid negative_distance nanmean: 1.400707 2019-11-15 21:43:13.623: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:44:47.283: INFO @metrics_hook: train matching accuracy: 0.9923954028808855, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 21:44:48.188: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:44:48.337: INFO @evaluate_embedding: best threshold 1.040650010108948 2019-11-15 21:44:48.396: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:44:48.397: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:44:48.581: INFO @decay_lr : LR updated to `9.624508e-05` 2019-11-15 21:44:48.582: INFO @log_profile : T train: 42.773319 2019-11-15 21:44:48.582: INFO @log_profile : T valid: 1.308681 2019-11-15 21:44:48.582: INFO @log_profile : T read data: 36.649565 2019-11-15 21:44:48.582: INFO @log_profile : T hooks: 100.181270 2019-11-15 21:44:48.583: INFO @main_loop : Epoch 467 done 2019-11-15 21:44:48.583: INFO @main_loop : Training epoch 468 2019-11-15 21:46:12.985: INFO @log_variables: train loss nanmean: 0.032682 2019-11-15 21:46:12.985: INFO @log_variables: train positive_distance nanmean: 0.553805 2019-11-15 21:46:12.985: INFO @log_variables: train negative_distance nanmean: 1.419445 2019-11-15 21:46:12.985: INFO @log_variables: valid loss nanmean: 0.273171 2019-11-15 21:46:12.985: INFO @log_variables: valid positive_distance nanmean: 0.681374 2019-11-15 21:46:12.985: INFO @log_variables: valid negative_distance nanmean: 1.400757 2019-11-15 21:46:12.985: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:47:47.341: INFO @metrics_hook: train matching accuracy: 0.99267578125, N=110592, DB_SIZE=110592, N_IDS=7306 2019-11-15 21:47:48.303: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:47:48.494: INFO @evaluate_embedding: best threshold 1.0410654544830322 2019-11-15 21:47:48.556: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:47:48.556: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:47:48.747: INFO @decay_lr : LR updated to `9.5763855e-05` 2019-11-15 21:47:48.749: INFO @log_profile : T train: 43.449200 2019-11-15 21:47:48.749: INFO @log_profile : T valid: 1.304421 2019-11-15 21:47:48.749: INFO @log_profile : T read data: 34.454753 2019-11-15 21:47:48.749: INFO @log_profile : T hooks: 100.889330 2019-11-15 21:47:48.749: INFO @main_loop : Epoch 468 done 2019-11-15 21:47:48.749: INFO @main_loop : Training epoch 469 2019-11-15 21:49:14.684: INFO @log_variables: train loss nanmean: 0.032562 2019-11-15 21:49:14.684: INFO @log_variables: train positive_distance nanmean: 0.553354 2019-11-15 21:49:14.684: INFO @log_variables: train negative_distance nanmean: 1.419448 2019-11-15 21:49:14.684: INFO @log_variables: valid loss nanmean: 0.274637 2019-11-15 21:49:14.684: INFO @log_variables: valid positive_distance nanmean: 0.680459 2019-11-15 21:49:14.684: INFO @log_variables: valid negative_distance nanmean: 1.400596 2019-11-15 21:49:14.684: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:50:48.704: INFO @metrics_hook: train matching accuracy: 0.9922960069444444, N=110592, DB_SIZE=110592, N_IDS=7309 2019-11-15 21:50:49.633: INFO @metrics_hook: valid matching accuracy: 0.9864562226724966, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:50:49.782: INFO @evaluate_embedding: best threshold 1.040527880191803 2019-11-15 21:50:49.851: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:50:49.851: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:50:50.053: INFO @decay_lr : LR updated to `9.528504e-05` 2019-11-15 21:50:50.054: INFO @log_profile : T train: 44.245434 2019-11-15 21:50:50.055: INFO @log_profile : T valid: 1.409365 2019-11-15 21:50:50.055: INFO @log_profile : T read data: 35.252495 2019-11-15 21:50:50.055: INFO @log_profile : T hooks: 100.330332 2019-11-15 21:50:50.055: INFO @main_loop : Epoch 469 done 2019-11-15 21:50:50.055: INFO @main_loop : Training epoch 470 2019-11-15 21:52:15.010: INFO @log_variables: train loss nanmean: 0.032101 2019-11-15 21:52:15.010: INFO @log_variables: train positive_distance nanmean: 0.553069 2019-11-15 21:52:15.010: INFO @log_variables: train negative_distance nanmean: 1.419454 2019-11-15 21:52:15.010: INFO @log_variables: valid loss nanmean: 0.272450 2019-11-15 21:52:15.010: INFO @log_variables: valid positive_distance nanmean: 0.679281 2019-11-15 21:52:15.010: INFO @log_variables: valid negative_distance nanmean: 1.400931 2019-11-15 21:52:15.010: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:53:48.339: INFO @metrics_hook: train matching accuracy: 0.9930103443287037, N=110592, DB_SIZE=110592, N_IDS=7307 2019-11-15 21:53:49.221: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:53:49.413: INFO @evaluate_embedding: best threshold 1.040106177330017 2019-11-15 21:53:49.476: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:53:49.476: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:53:49.663: INFO @decay_lr : LR updated to `9.4808616e-05` 2019-11-15 21:53:49.665: INFO @log_profile : T train: 44.057541 2019-11-15 21:53:49.665: INFO @log_profile : T valid: 1.426803 2019-11-15 21:53:49.665: INFO @log_profile : T read data: 34.305931 2019-11-15 21:53:49.665: INFO @log_profile : T hooks: 99.751634 2019-11-15 21:53:49.665: INFO @main_loop : Epoch 470 done 2019-11-15 21:53:49.665: INFO @main_loop : Training epoch 471 2019-11-15 21:55:14.100: INFO @log_variables: train loss nanmean: 0.031976 2019-11-15 21:55:14.100: INFO @log_variables: train positive_distance nanmean: 0.553582 2019-11-15 21:55:14.100: INFO @log_variables: train negative_distance nanmean: 1.419445 2019-11-15 21:55:14.100: INFO @log_variables: valid loss nanmean: 0.271229 2019-11-15 21:55:14.100: INFO @log_variables: valid positive_distance nanmean: 0.678298 2019-11-15 21:55:14.100: INFO @log_variables: valid negative_distance nanmean: 1.400700 2019-11-15 21:55:14.100: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:56:48.515: INFO @metrics_hook: train matching accuracy: 0.992286825210236, N=110590, DB_SIZE=110592, N_IDS=7315 2019-11-15 21:56:49.371: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:56:49.530: INFO @evaluate_embedding: best threshold 1.03949898481369 2019-11-15 21:56:49.598: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:56:49.598: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:56:49.795: INFO @decay_lr : LR updated to `9.433457e-05` 2019-11-15 21:56:49.796: INFO @log_profile : T train: 44.348829 2019-11-15 21:56:49.796: INFO @log_profile : T valid: 1.420917 2019-11-15 21:56:49.796: INFO @log_profile : T read data: 33.327876 2019-11-15 21:56:49.796: INFO @log_profile : T hooks: 100.965643 2019-11-15 21:56:49.796: INFO @main_loop : Epoch 471 done 2019-11-15 21:56:49.796: INFO @main_loop : Training epoch 472 2019-11-15 21:58:14.963: INFO @log_variables: train loss nanmean: 0.032451 2019-11-15 21:58:14.963: INFO @log_variables: train positive_distance nanmean: 0.552767 2019-11-15 21:58:14.963: INFO @log_variables: train negative_distance nanmean: 1.419431 2019-11-15 21:58:14.963: INFO @log_variables: valid loss nanmean: 0.271231 2019-11-15 21:58:14.963: INFO @log_variables: valid positive_distance nanmean: 0.679628 2019-11-15 21:58:14.963: INFO @log_variables: valid negative_distance nanmean: 1.401011 2019-11-15 21:58:14.963: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 21:59:45.731: INFO @metrics_hook: train matching accuracy: 0.9916177627474206, N=110591, DB_SIZE=110592, N_IDS=7305 2019-11-15 21:59:46.778: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 21:59:46.950: INFO @evaluate_embedding: best threshold 1.0403194725513456 2019-11-15 21:59:47.015: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 21:59:47.015: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 21:59:47.188: INFO @decay_lr : LR updated to `9.38629e-05` 2019-11-15 21:59:47.189: INFO @log_profile : T train: 44.245231 2019-11-15 21:59:47.189: INFO @log_profile : T valid: 1.418915 2019-11-15 21:59:47.189: INFO @log_profile : T read data: 34.287451 2019-11-15 21:59:47.189: INFO @log_profile : T hooks: 97.373618 2019-11-15 21:59:47.189: INFO @main_loop : Epoch 472 done 2019-11-15 21:59:47.189: INFO @main_loop : Training epoch 473 2019-11-15 22:01:10.740: INFO @log_variables: train loss nanmean: 0.031997 2019-11-15 22:01:10.741: INFO @log_variables: train positive_distance nanmean: 0.553178 2019-11-15 22:01:10.741: INFO @log_variables: train negative_distance nanmean: 1.419441 2019-11-15 22:01:10.741: INFO @log_variables: valid loss nanmean: 0.271934 2019-11-15 22:01:10.741: INFO @log_variables: valid positive_distance nanmean: 0.679627 2019-11-15 22:01:10.741: INFO @log_variables: valid negative_distance nanmean: 1.400711 2019-11-15 22:01:10.741: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:02:44.571: INFO @metrics_hook: train matching accuracy: 0.9919614438657407, N=110592, DB_SIZE=110592, N_IDS=7308 2019-11-15 22:02:45.468: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:02:45.611: INFO @evaluate_embedding: best threshold 1.0401686429977415 2019-11-15 22:02:45.674: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:02:45.674: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:02:45.858: INFO @decay_lr : LR updated to `9.339359e-05` 2019-11-15 22:02:45.859: INFO @log_profile : T train: 43.872211 2019-11-15 22:02:45.859: INFO @log_profile : T valid: 1.302582 2019-11-15 22:02:45.859: INFO @log_profile : T read data: 33.440599 2019-11-15 22:02:45.859: INFO @log_profile : T hooks: 99.985740 2019-11-15 22:02:45.859: INFO @main_loop : Epoch 473 done 2019-11-15 22:02:45.859: INFO @main_loop : Training epoch 474 2019-11-15 22:04:13.298: INFO @log_variables: train loss nanmean: 0.032461 2019-11-15 22:04:13.298: INFO @log_variables: train positive_distance nanmean: 0.553251 2019-11-15 22:04:13.298: INFO @log_variables: train negative_distance nanmean: 1.419457 2019-11-15 22:04:13.298: INFO @log_variables: valid loss nanmean: 0.270876 2019-11-15 22:04:13.298: INFO @log_variables: valid positive_distance nanmean: 0.680856 2019-11-15 22:04:13.298: INFO @log_variables: valid negative_distance nanmean: 1.400945 2019-11-15 22:04:13.298: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:05:49.171: INFO @metrics_hook: train matching accuracy: 0.9916177627474206, N=110591, DB_SIZE=110592, N_IDS=7306 2019-11-15 22:05:50.065: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:05:50.219: INFO @evaluate_embedding: best threshold 1.0409003794193266 2019-11-15 22:05:50.282: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:05:50.282: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:05:50.481: INFO @decay_lr : LR updated to `9.292662e-05` 2019-11-15 22:05:50.482: INFO @log_profile : T train: 43.739606 2019-11-15 22:05:50.482: INFO @log_profile : T valid: 1.307775 2019-11-15 22:05:50.483: INFO @log_profile : T read data: 37.322122 2019-11-15 22:05:50.483: INFO @log_profile : T hooks: 102.185396 2019-11-15 22:05:50.483: INFO @main_loop : Epoch 474 done 2019-11-15 22:05:50.483: INFO @main_loop : Training epoch 475 2019-11-15 22:07:13.232: INFO @log_variables: train loss nanmean: 0.033296 2019-11-15 22:07:13.232: INFO @log_variables: train positive_distance nanmean: 0.553926 2019-11-15 22:07:13.232: INFO @log_variables: train negative_distance nanmean: 1.419453 2019-11-15 22:07:13.232: INFO @log_variables: valid loss nanmean: 0.270440 2019-11-15 22:07:13.232: INFO @log_variables: valid positive_distance nanmean: 0.681196 2019-11-15 22:07:13.232: INFO @log_variables: valid negative_distance nanmean: 1.400888 2019-11-15 22:07:13.232: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:08:46.553: INFO @metrics_hook: train matching accuracy: 0.992322994845827, N=110590, DB_SIZE=110592, N_IDS=7309 2019-11-15 22:08:47.413: INFO @metrics_hook: valid matching accuracy: 0.9874160179161778, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:08:47.571: INFO @evaluate_embedding: best threshold 1.0410421192646027 2019-11-15 22:08:47.643: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:08:47.643: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:08:47.826: INFO @decay_lr : LR updated to `9.246198e-05` 2019-11-15 22:08:47.828: INFO @log_profile : T train: 42.804632 2019-11-15 22:08:47.828: INFO @log_profile : T valid: 1.304717 2019-11-15 22:08:47.828: INFO @log_profile : T read data: 33.735478 2019-11-15 22:08:47.828: INFO @log_profile : T hooks: 99.432204 2019-11-15 22:08:47.828: INFO @main_loop : Epoch 475 done 2019-11-15 22:08:47.828: INFO @main_loop : Training epoch 476 2019-11-15 22:10:15.607: INFO @log_variables: train loss nanmean: 0.032485 2019-11-15 22:10:15.607: INFO @log_variables: train positive_distance nanmean: 0.553844 2019-11-15 22:10:15.607: INFO @log_variables: train negative_distance nanmean: 1.419458 2019-11-15 22:10:15.607: INFO @log_variables: valid loss nanmean: 0.272340 2019-11-15 22:10:15.607: INFO @log_variables: valid positive_distance nanmean: 0.680159 2019-11-15 22:10:15.607: INFO @log_variables: valid negative_distance nanmean: 1.400865 2019-11-15 22:10:15.608: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:11:47.950: INFO @metrics_hook: train matching accuracy: 0.9927661382933511, N=110591, DB_SIZE=110592, N_IDS=7306 2019-11-15 22:11:48.999: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:11:49.141: INFO @evaluate_embedding: best threshold 1.0405119955539703 2019-11-15 22:11:49.225: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:11:49.225: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:11:49.403: INFO @decay_lr : LR updated to `9.1999675e-05` 2019-11-15 22:11:49.405: INFO @log_profile : T train: 44.188083 2019-11-15 22:11:49.405: INFO @log_profile : T valid: 1.416666 2019-11-15 22:11:49.405: INFO @log_profile : T read data: 36.979923 2019-11-15 22:11:49.405: INFO @log_profile : T hooks: 98.923513 2019-11-15 22:11:49.405: INFO @main_loop : Epoch 476 done 2019-11-15 22:11:49.405: INFO @main_loop : Training epoch 477 2019-11-15 22:13:13.598: INFO @log_variables: train loss nanmean: 0.032246 2019-11-15 22:13:13.599: INFO @log_variables: train positive_distance nanmean: 0.553038 2019-11-15 22:13:13.599: INFO @log_variables: train negative_distance nanmean: 1.419455 2019-11-15 22:13:13.599: INFO @log_variables: valid loss nanmean: 0.273564 2019-11-15 22:13:13.599: INFO @log_variables: valid positive_distance nanmean: 0.680691 2019-11-15 22:13:13.599: INFO @log_variables: valid negative_distance nanmean: 1.400712 2019-11-15 22:13:13.599: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:14:45.193: INFO @metrics_hook: train matching accuracy: 0.9916359230324074, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 22:14:46.225: INFO @metrics_hook: valid matching accuracy: 0.987629305748107, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:14:46.366: INFO @evaluate_embedding: best threshold 1.0407018661499023 2019-11-15 22:14:46.431: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:14:46.432: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:14:46.608: INFO @decay_lr : LR updated to `9.1539674e-05` 2019-11-15 22:14:46.610: INFO @log_profile : T train: 43.712528 2019-11-15 22:14:46.610: INFO @log_profile : T valid: 1.290266 2019-11-15 22:14:46.610: INFO @log_profile : T read data: 34.275281 2019-11-15 22:14:46.610: INFO @log_profile : T hooks: 97.859378 2019-11-15 22:14:46.610: INFO @main_loop : Epoch 477 done 2019-11-15 22:14:46.610: INFO @main_loop : Training epoch 478 2019-11-15 22:16:12.045: INFO @log_variables: train loss nanmean: 0.032455 2019-11-15 22:16:12.045: INFO @log_variables: train positive_distance nanmean: 0.553661 2019-11-15 22:16:12.045: INFO @log_variables: train negative_distance nanmean: 1.419438 2019-11-15 22:16:12.045: INFO @log_variables: valid loss nanmean: 0.272837 2019-11-15 22:16:12.045: INFO @log_variables: valid positive_distance nanmean: 0.680636 2019-11-15 22:16:12.045: INFO @log_variables: valid negative_distance nanmean: 1.400810 2019-11-15 22:16:12.045: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:17:46.316: INFO @metrics_hook: train matching accuracy: 0.9922416833196191, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 22:17:47.143: INFO @metrics_hook: valid matching accuracy: 0.9878425935800362, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:17:47.321: INFO @evaluate_embedding: best threshold 1.0407229661941526 2019-11-15 22:17:47.388: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:17:47.388: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:17:47.574: INFO @decay_lr : LR updated to `9.108197e-05` 2019-11-15 22:17:47.575: INFO @log_profile : T train: 44.306019 2019-11-15 22:17:47.575: INFO @log_profile : T valid: 1.426050 2019-11-15 22:17:47.575: INFO @log_profile : T read data: 34.655425 2019-11-15 22:17:47.575: INFO @log_profile : T hooks: 100.509532 2019-11-15 22:17:47.576: INFO @main_loop : Epoch 478 done 2019-11-15 22:17:47.576: INFO @main_loop : Training epoch 479 2019-11-15 22:19:12.625: INFO @log_variables: train loss nanmean: 0.030809 2019-11-15 22:19:12.626: INFO @log_variables: train positive_distance nanmean: 0.553180 2019-11-15 22:19:12.626: INFO @log_variables: train negative_distance nanmean: 1.419452 2019-11-15 22:19:12.626: INFO @log_variables: valid loss nanmean: 0.272659 2019-11-15 22:19:12.626: INFO @log_variables: valid positive_distance nanmean: 0.681152 2019-11-15 22:19:12.626: INFO @log_variables: valid negative_distance nanmean: 1.401161 2019-11-15 22:19:12.626: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:20:46.466: INFO @metrics_hook: train matching accuracy: 0.9919252748842593, N=110592, DB_SIZE=110592, N_IDS=7318 2019-11-15 22:20:47.476: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:20:47.619: INFO @evaluate_embedding: best threshold 1.0411564409732819 2019-11-15 22:20:47.686: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:20:47.686: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:20:47.897: INFO @decay_lr : LR updated to `9.062656e-05` 2019-11-15 22:20:47.898: INFO @log_profile : T train: 44.209576 2019-11-15 22:20:47.898: INFO @log_profile : T valid: 1.440942 2019-11-15 22:20:47.898: INFO @log_profile : T read data: 34.164002 2019-11-15 22:20:47.899: INFO @log_profile : T hooks: 100.439152 2019-11-15 22:20:47.899: INFO @main_loop : Epoch 479 done 2019-11-15 22:20:47.899: INFO @main_loop : Training epoch 480 2019-11-15 22:22:14.388: INFO @log_variables: train loss nanmean: 0.031626 2019-11-15 22:22:14.388: INFO @log_variables: train positive_distance nanmean: 0.552645 2019-11-15 22:22:14.388: INFO @log_variables: train negative_distance nanmean: 1.419447 2019-11-15 22:22:14.388: INFO @log_variables: valid loss nanmean: 0.272912 2019-11-15 22:22:14.388: INFO @log_variables: valid positive_distance nanmean: 0.680197 2019-11-15 22:22:14.388: INFO @log_variables: valid negative_distance nanmean: 1.400806 2019-11-15 22:22:14.388: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:23:47.026: INFO @metrics_hook: train matching accuracy: 0.9926484550904702, N=110589, DB_SIZE=110592, N_IDS=7310 2019-11-15 22:23:47.822: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:23:47.984: INFO @evaluate_embedding: best threshold 1.0405012369155884 2019-11-15 22:23:48.056: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:23:48.056: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:23:48.249: INFO @decay_lr : LR updated to `9.017343e-05` 2019-11-15 22:23:48.250: INFO @log_profile : T train: 44.271774 2019-11-15 22:23:48.250: INFO @log_profile : T valid: 1.410451 2019-11-15 22:23:48.250: INFO @log_profile : T read data: 35.514575 2019-11-15 22:23:48.250: INFO @log_profile : T hooks: 99.080005 2019-11-15 22:23:48.250: INFO @main_loop : Epoch 480 done 2019-11-15 22:23:48.250: INFO @main_loop : Training epoch 481 2019-11-15 22:25:13.446: INFO @log_variables: train loss nanmean: 0.031882 2019-11-15 22:25:13.447: INFO @log_variables: train positive_distance nanmean: 0.552231 2019-11-15 22:25:13.447: INFO @log_variables: train negative_distance nanmean: 1.419454 2019-11-15 22:25:13.447: INFO @log_variables: valid loss nanmean: 0.271164 2019-11-15 22:25:13.447: INFO @log_variables: valid positive_distance nanmean: 0.679989 2019-11-15 22:25:13.447: INFO @log_variables: valid negative_distance nanmean: 1.400738 2019-11-15 22:25:13.447: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:26:48.129: INFO @metrics_hook: train matching accuracy: 0.9921331753940194, N=110591, DB_SIZE=110592, N_IDS=7310 2019-11-15 22:26:49.061: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:26:49.236: INFO @evaluate_embedding: best threshold 1.0403635203838348 2019-11-15 22:26:49.304: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:26:49.304: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:26:49.488: INFO @decay_lr : LR updated to `8.972256e-05` 2019-11-15 22:26:49.489: INFO @log_profile : T train: 44.183243 2019-11-15 22:26:49.489: INFO @log_profile : T valid: 1.415034 2019-11-15 22:26:49.489: INFO @log_profile : T read data: 34.381160 2019-11-15 22:26:49.489: INFO @log_profile : T hooks: 101.191479 2019-11-15 22:26:49.490: INFO @main_loop : Epoch 481 done 2019-11-15 22:26:49.490: INFO @main_loop : Training epoch 482 2019-11-15 22:28:13.321: INFO @log_variables: train loss nanmean: 0.032165 2019-11-15 22:28:13.321: INFO @log_variables: train positive_distance nanmean: 0.553252 2019-11-15 22:28:13.321: INFO @log_variables: train negative_distance nanmean: 1.419450 2019-11-15 22:28:13.321: INFO @log_variables: valid loss nanmean: 0.274083 2019-11-15 22:28:13.321: INFO @log_variables: valid positive_distance nanmean: 0.681918 2019-11-15 22:28:13.321: INFO @log_variables: valid negative_distance nanmean: 1.400700 2019-11-15 22:28:13.321: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:29:47.701: INFO @metrics_hook: train matching accuracy: 0.9921422177211527, N=110591, DB_SIZE=110592, N_IDS=7318 2019-11-15 22:29:48.507: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:29:48.675: INFO @evaluate_embedding: best threshold 1.0413091182708738 2019-11-15 22:29:48.739: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:29:48.739: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:29:48.922: INFO @decay_lr : LR updated to `8.927395e-05` 2019-11-15 22:29:48.923: INFO @log_profile : T train: 44.269011 2019-11-15 22:29:48.923: INFO @log_profile : T valid: 1.424767 2019-11-15 22:29:48.923: INFO @log_profile : T read data: 33.030286 2019-11-15 22:29:48.923: INFO @log_profile : T hooks: 100.641940 2019-11-15 22:29:48.924: INFO @main_loop : Epoch 482 done 2019-11-15 22:29:48.924: INFO @main_loop : Training epoch 483 2019-11-15 22:31:12.189: INFO @log_variables: train loss nanmean: 0.032247 2019-11-15 22:31:12.189: INFO @log_variables: train positive_distance nanmean: 0.553201 2019-11-15 22:31:12.189: INFO @log_variables: train negative_distance nanmean: 1.419448 2019-11-15 22:31:12.189: INFO @log_variables: valid loss nanmean: 0.272343 2019-11-15 22:31:12.189: INFO @log_variables: valid positive_distance nanmean: 0.681261 2019-11-15 22:31:12.189: INFO @log_variables: valid negative_distance nanmean: 1.400994 2019-11-15 22:31:12.189: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:32:45.825: INFO @metrics_hook: train matching accuracy: 0.9920517944498196, N=110591, DB_SIZE=110592, N_IDS=7312 2019-11-15 22:32:46.704: INFO @metrics_hook: valid matching accuracy: 0.9875226618321424, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:32:46.889: INFO @evaluate_embedding: best threshold 1.041127234697342 2019-11-15 22:32:46.954: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:32:46.955: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:32:47.145: INFO @decay_lr : LR updated to `8.8827575e-05` 2019-11-15 22:32:47.146: INFO @log_profile : T train: 43.445251 2019-11-15 22:32:47.146: INFO @log_profile : T valid: 1.304503 2019-11-15 22:32:47.146: INFO @log_profile : T read data: 33.610767 2019-11-15 22:32:47.146: INFO @log_profile : T hooks: 99.793319 2019-11-15 22:32:47.147: INFO @main_loop : Epoch 483 done 2019-11-15 22:32:47.147: INFO @main_loop : Training epoch 484 2019-11-15 22:34:10.943: INFO @log_variables: train loss nanmean: 0.033188 2019-11-15 22:34:10.943: INFO @log_variables: train positive_distance nanmean: 0.553998 2019-11-15 22:34:10.943: INFO @log_variables: train negative_distance nanmean: 1.419437 2019-11-15 22:34:10.943: INFO @log_variables: valid loss nanmean: 0.270996 2019-11-15 22:34:10.943: INFO @log_variables: valid positive_distance nanmean: 0.680320 2019-11-15 22:34:10.943: INFO @log_variables: valid negative_distance nanmean: 1.400499 2019-11-15 22:34:10.943: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:35:44.153: INFO @metrics_hook: train matching accuracy: 0.9922869646990741, N=110592, DB_SIZE=110592, N_IDS=7303 2019-11-15 22:35:45.015: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:35:45.191: INFO @evaluate_embedding: best threshold 1.040409415960312 2019-11-15 22:35:45.252: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:35:45.252: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:35:45.459: INFO @decay_lr : LR updated to `8.838344e-05` 2019-11-15 22:35:45.460: INFO @log_profile : T train: 44.255549 2019-11-15 22:35:45.460: INFO @log_profile : T valid: 1.428403 2019-11-15 22:35:45.460: INFO @log_profile : T read data: 32.890195 2019-11-15 22:35:45.460: INFO @log_profile : T hooks: 99.670246 2019-11-15 22:35:45.460: INFO @main_loop : Epoch 484 done 2019-11-15 22:35:45.460: INFO @main_loop : Training epoch 485 2019-11-15 22:37:10.734: INFO @log_variables: train loss nanmean: 0.032137 2019-11-15 22:37:10.735: INFO @log_variables: train positive_distance nanmean: 0.553737 2019-11-15 22:37:10.735: INFO @log_variables: train negative_distance nanmean: 1.419440 2019-11-15 22:37:10.735: INFO @log_variables: valid loss nanmean: 0.271566 2019-11-15 22:37:10.735: INFO @log_variables: valid positive_distance nanmean: 0.680782 2019-11-15 22:37:10.735: INFO @log_variables: valid negative_distance nanmean: 1.400935 2019-11-15 22:37:10.735: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:38:43.636: INFO @metrics_hook: train matching accuracy: 0.9925944010416666, N=110592, DB_SIZE=110592, N_IDS=7313 2019-11-15 22:38:44.446: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:38:44.615: INFO @evaluate_embedding: best threshold 1.040858268737793 2019-11-15 22:38:44.687: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:38:44.687: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:38:44.862: INFO @decay_lr : LR updated to `8.794152e-05` 2019-11-15 22:38:44.863: INFO @log_profile : T train: 43.157564 2019-11-15 22:38:44.863: INFO @log_profile : T valid: 1.301510 2019-11-15 22:38:44.863: INFO @log_profile : T read data: 35.782582 2019-11-15 22:38:44.863: INFO @log_profile : T hooks: 99.091561 2019-11-15 22:38:44.864: INFO @main_loop : Epoch 485 done 2019-11-15 22:38:44.864: INFO @main_loop : Training epoch 486 2019-11-15 22:40:08.576: INFO @log_variables: train loss nanmean: 0.030954 2019-11-15 22:40:08.577: INFO @log_variables: train positive_distance nanmean: 0.552524 2019-11-15 22:40:08.577: INFO @log_variables: train negative_distance nanmean: 1.419452 2019-11-15 22:40:08.577: INFO @log_variables: valid loss nanmean: 0.272013 2019-11-15 22:40:08.577: INFO @log_variables: valid positive_distance nanmean: 0.680746 2019-11-15 22:40:08.577: INFO @log_variables: valid negative_distance nanmean: 1.400700 2019-11-15 22:40:08.577: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:41:43.642: INFO @metrics_hook: train matching accuracy: 0.9923321759259259, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 22:41:44.493: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:41:44.655: INFO @evaluate_embedding: best threshold 1.0407232344150545 2019-11-15 22:41:44.716: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:41:44.716: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:41:44.889: INFO @decay_lr : LR updated to `8.750181e-05` 2019-11-15 22:41:44.891: INFO @log_profile : T train: 42.917154 2019-11-15 22:41:44.891: INFO @log_profile : T valid: 1.300256 2019-11-15 22:41:44.891: INFO @log_profile : T read data: 34.379639 2019-11-15 22:41:44.891: INFO @log_profile : T hooks: 101.361583 2019-11-15 22:41:44.891: INFO @main_loop : Epoch 486 done 2019-11-15 22:41:44.891: INFO @main_loop : Training epoch 487 2019-11-15 22:43:10.811: INFO @log_variables: train loss nanmean: 0.032784 2019-11-15 22:43:10.811: INFO @log_variables: train positive_distance nanmean: 0.553736 2019-11-15 22:43:10.811: INFO @log_variables: train negative_distance nanmean: 1.419452 2019-11-15 22:43:10.811: INFO @log_variables: valid loss nanmean: 0.271533 2019-11-15 22:43:10.811: INFO @log_variables: valid positive_distance nanmean: 0.680530 2019-11-15 22:43:10.811: INFO @log_variables: valid negative_distance nanmean: 1.400936 2019-11-15 22:43:10.811: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:44:45.130: INFO @metrics_hook: train matching accuracy: 0.992675715022018, N=110591, DB_SIZE=110592, N_IDS=7318 2019-11-15 22:44:46.068: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:44:46.234: INFO @evaluate_embedding: best threshold 1.0407331287860875 2019-11-15 22:44:46.298: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:44:46.298: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:44:46.493: INFO @decay_lr : LR updated to `8.70643e-05` 2019-11-15 22:44:46.494: INFO @log_profile : T train: 44.132134 2019-11-15 22:44:46.495: INFO @log_profile : T valid: 1.300335 2019-11-15 22:44:46.495: INFO @log_profile : T read data: 35.369332 2019-11-15 22:44:46.495: INFO @log_profile : T hooks: 100.733639 2019-11-15 22:44:46.495: INFO @main_loop : Epoch 487 done 2019-11-15 22:44:46.495: INFO @main_loop : Training epoch 488 2019-11-15 22:46:11.651: INFO @log_variables: train loss nanmean: 0.031985 2019-11-15 22:46:11.652: INFO @log_variables: train positive_distance nanmean: 0.553657 2019-11-15 22:46:11.652: INFO @log_variables: train negative_distance nanmean: 1.419448 2019-11-15 22:46:11.652: INFO @log_variables: valid loss nanmean: 0.273515 2019-11-15 22:46:11.652: INFO @log_variables: valid positive_distance nanmean: 0.680512 2019-11-15 22:46:11.652: INFO @log_variables: valid negative_distance nanmean: 1.400867 2019-11-15 22:46:11.652: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:47:46.465: INFO @metrics_hook: train matching accuracy: 0.9921694155092593, N=110592, DB_SIZE=110592, N_IDS=7317 2019-11-15 22:47:47.374: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:47:47.563: INFO @evaluate_embedding: best threshold 1.0406898558139799 2019-11-15 22:47:47.630: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:47:47.630: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:47:47.833: INFO @decay_lr : LR updated to `8.662898e-05` 2019-11-15 22:47:47.834: INFO @log_profile : T train: 44.366361 2019-11-15 22:47:47.834: INFO @log_profile : T valid: 1.412381 2019-11-15 22:47:47.834: INFO @log_profile : T read data: 34.586037 2019-11-15 22:47:47.834: INFO @log_profile : T hooks: 100.906734 2019-11-15 22:47:47.835: INFO @main_loop : Epoch 488 done 2019-11-15 22:47:47.835: INFO @main_loop : Training epoch 489 2019-11-15 22:49:12.094: INFO @log_variables: train loss nanmean: 0.032143 2019-11-15 22:49:12.095: INFO @log_variables: train positive_distance nanmean: 0.553755 2019-11-15 22:49:12.095: INFO @log_variables: train negative_distance nanmean: 1.419456 2019-11-15 22:49:12.095: INFO @log_variables: valid loss nanmean: 0.273336 2019-11-15 22:49:12.095: INFO @log_variables: valid positive_distance nanmean: 0.681179 2019-11-15 22:49:12.095: INFO @log_variables: valid negative_distance nanmean: 1.400924 2019-11-15 22:49:12.095: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:50:45.996: INFO @metrics_hook: train matching accuracy: 0.992295937282419, N=110591, DB_SIZE=110592, N_IDS=7307 2019-11-15 22:50:46.842: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:50:47.008: INFO @evaluate_embedding: best threshold 1.0410516560077667 2019-11-15 22:50:47.073: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:50:47.073: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:50:47.274: INFO @decay_lr : LR updated to `8.619583e-05` 2019-11-15 22:50:47.275: INFO @log_profile : T train: 44.078566 2019-11-15 22:50:47.275: INFO @log_profile : T valid: 1.379312 2019-11-15 22:50:47.275: INFO @log_profile : T read data: 33.766739 2019-11-15 22:50:47.275: INFO @log_profile : T hooks: 100.148395 2019-11-15 22:50:47.275: INFO @main_loop : Epoch 489 done 2019-11-15 22:50:47.275: INFO @main_loop : Training epoch 490 2019-11-15 22:52:12.011: INFO @log_variables: train loss nanmean: 0.031392 2019-11-15 22:52:12.011: INFO @log_variables: train positive_distance nanmean: 0.553526 2019-11-15 22:52:12.011: INFO @log_variables: train negative_distance nanmean: 1.419444 2019-11-15 22:52:12.011: INFO @log_variables: valid loss nanmean: 0.273340 2019-11-15 22:52:12.011: INFO @log_variables: valid positive_distance nanmean: 0.682498 2019-11-15 22:52:12.011: INFO @log_variables: valid negative_distance nanmean: 1.400899 2019-11-15 22:52:12.011: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:53:48.274: INFO @metrics_hook: train matching accuracy: 0.9920156251412864, N=110591, DB_SIZE=110592, N_IDS=7298 2019-11-15 22:53:49.213: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:53:49.366: INFO @evaluate_embedding: best threshold 1.0416985452175138 2019-11-15 22:53:49.428: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:53:49.428: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:53:49.612: INFO @decay_lr : LR updated to `8.5764856e-05` 2019-11-15 22:53:49.613: INFO @log_profile : T train: 43.972795 2019-11-15 22:53:49.613: INFO @log_profile : T valid: 1.423864 2019-11-15 22:53:49.613: INFO @log_profile : T read data: 34.175307 2019-11-15 22:53:49.613: INFO @log_profile : T hooks: 102.698113 2019-11-15 22:53:49.614: INFO @main_loop : Epoch 490 done 2019-11-15 22:53:49.614: INFO @main_loop : Training epoch 491 2019-11-15 22:55:14.307: INFO @log_variables: train loss nanmean: 0.031946 2019-11-15 22:55:14.308: INFO @log_variables: train positive_distance nanmean: 0.553675 2019-11-15 22:55:14.308: INFO @log_variables: train negative_distance nanmean: 1.419444 2019-11-15 22:55:14.308: INFO @log_variables: valid loss nanmean: 0.274157 2019-11-15 22:55:14.308: INFO @log_variables: valid positive_distance nanmean: 0.682013 2019-11-15 22:55:14.308: INFO @log_variables: valid negative_distance nanmean: 1.400623 2019-11-15 22:55:14.308: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:56:47.739: INFO @metrics_hook: train matching accuracy: 0.99267578125, N=110592, DB_SIZE=110592, N_IDS=7311 2019-11-15 22:56:48.582: INFO @metrics_hook: valid matching accuracy: 0.9872027300842487, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:56:48.732: INFO @evaluate_embedding: best threshold 1.0413182079792023 2019-11-15 22:56:48.792: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:56:48.792: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:56:48.982: INFO @decay_lr : LR updated to `8.533603e-05` 2019-11-15 22:56:48.983: INFO @log_profile : T train: 43.533568 2019-11-15 22:56:48.983: INFO @log_profile : T valid: 1.273076 2019-11-15 22:56:48.983: INFO @log_profile : T read data: 34.933925 2019-11-15 22:56:48.983: INFO @log_profile : T hooks: 99.561038 2019-11-15 22:56:48.983: INFO @main_loop : Epoch 491 done 2019-11-15 22:56:48.983: INFO @main_loop : Training epoch 492 2019-11-15 22:58:13.476: INFO @log_variables: train loss nanmean: 0.032246 2019-11-15 22:58:13.477: INFO @log_variables: train positive_distance nanmean: 0.553536 2019-11-15 22:58:13.477: INFO @log_variables: train negative_distance nanmean: 1.419435 2019-11-15 22:58:13.477: INFO @log_variables: valid loss nanmean: 0.275714 2019-11-15 22:58:13.477: INFO @log_variables: valid positive_distance nanmean: 0.682656 2019-11-15 22:58:13.477: INFO @log_variables: valid negative_distance nanmean: 1.400696 2019-11-15 22:58:13.477: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 22:59:48.155: INFO @metrics_hook: train matching accuracy: 0.9925400801150184, N=110591, DB_SIZE=110592, N_IDS=7313 2019-11-15 22:59:49.104: INFO @metrics_hook: valid matching accuracy: 0.9869894422523195, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 22:59:49.272: INFO @evaluate_embedding: best threshold 1.0416758358478544 2019-11-15 22:59:49.333: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 22:59:49.333: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 22:59:49.518: INFO @decay_lr : LR updated to `8.4909356e-05` 2019-11-15 22:59:49.519: INFO @log_profile : T train: 45.209706 2019-11-15 22:59:49.519: INFO @log_profile : T valid: 1.424693 2019-11-15 22:59:49.519: INFO @log_profile : T read data: 32.713259 2019-11-15 22:59:49.519: INFO @log_profile : T hooks: 101.119695 2019-11-15 22:59:49.519: INFO @main_loop : Epoch 492 done 2019-11-15 22:59:49.519: INFO @main_loop : Training epoch 493 2019-11-15 23:01:15.487: INFO @log_variables: train loss nanmean: 0.031791 2019-11-15 23:01:15.487: INFO @log_variables: train positive_distance nanmean: 0.553660 2019-11-15 23:01:15.487: INFO @log_variables: train negative_distance nanmean: 1.419441 2019-11-15 23:01:15.487: INFO @log_variables: valid loss nanmean: 0.273173 2019-11-15 23:01:15.487: INFO @log_variables: valid positive_distance nanmean: 0.682600 2019-11-15 23:01:15.488: INFO @log_variables: valid negative_distance nanmean: 1.400767 2019-11-15 23:01:15.488: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 23:02:48.598: INFO @metrics_hook: train matching accuracy: 0.9925130208333334, N=110592, DB_SIZE=110592, N_IDS=7315 2019-11-15 23:02:49.497: INFO @metrics_hook: valid matching accuracy: 0.9862429348405674, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 23:02:49.647: INFO @evaluate_embedding: best threshold 1.0416833162307741 2019-11-15 23:02:49.713: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 23:02:49.713: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 23:02:49.893: INFO @decay_lr : LR updated to `8.448481e-05` 2019-11-15 23:02:49.895: INFO @log_profile : T train: 43.126439 2019-11-15 23:02:49.895: INFO @log_profile : T valid: 1.294423 2019-11-15 23:02:49.895: INFO @log_profile : T read data: 36.145805 2019-11-15 23:02:49.895: INFO @log_profile : T hooks: 99.740721 2019-11-15 23:02:49.895: INFO @main_loop : Epoch 493 done 2019-11-15 23:02:49.895: INFO @main_loop : Training epoch 494 2019-11-15 23:04:12.884: INFO @log_variables: train loss nanmean: 0.032691 2019-11-15 23:04:12.885: INFO @log_variables: train positive_distance nanmean: 0.553514 2019-11-15 23:04:12.885: INFO @log_variables: train negative_distance nanmean: 1.419446 2019-11-15 23:04:12.885: INFO @log_variables: valid loss nanmean: 0.273192 2019-11-15 23:04:12.885: INFO @log_variables: valid positive_distance nanmean: 0.682069 2019-11-15 23:04:12.885: INFO @log_variables: valid negative_distance nanmean: 1.400828 2019-11-15 23:04:12.885: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 23:05:48.080: INFO @metrics_hook: train matching accuracy: 0.9922055844907407, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 23:05:48.940: INFO @metrics_hook: valid matching accuracy: 0.9867761544203904, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 23:05:49.107: INFO @evaluate_embedding: best threshold 1.0414484441280363 2019-11-15 23:05:49.190: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 23:05:49.190: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 23:05:49.373: INFO @decay_lr : LR updated to `8.406238e-05` 2019-11-15 23:05:49.375: INFO @log_profile : T train: 44.151120 2019-11-15 23:05:49.375: INFO @log_profile : T valid: 1.307055 2019-11-15 23:05:49.375: INFO @log_profile : T read data: 32.452681 2019-11-15 23:05:49.375: INFO @log_profile : T hooks: 101.501661 2019-11-15 23:05:49.375: INFO @main_loop : Epoch 494 done 2019-11-15 23:05:49.375: INFO @main_loop : Training epoch 495 2019-11-15 23:07:12.921: INFO @log_variables: train loss nanmean: 0.032892 2019-11-15 23:07:12.921: INFO @log_variables: train positive_distance nanmean: 0.554200 2019-11-15 23:07:12.921: INFO @log_variables: train negative_distance nanmean: 1.419438 2019-11-15 23:07:12.921: INFO @log_variables: valid loss nanmean: 0.274614 2019-11-15 23:07:12.921: INFO @log_variables: valid positive_distance nanmean: 0.682933 2019-11-15 23:07:12.921: INFO @log_variables: valid negative_distance nanmean: 1.400904 2019-11-15 23:07:12.921: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 23:08:47.005: INFO @metrics_hook: train matching accuracy: 0.9926576967592593, N=110592, DB_SIZE=110592, N_IDS=7304 2019-11-15 23:08:47.957: INFO @metrics_hook: valid matching accuracy: 0.9870960861682841, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 23:08:48.101: INFO @evaluate_embedding: best threshold 1.0419189035892487 2019-11-15 23:08:48.166: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 23:08:48.166: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 23:08:48.344: INFO @decay_lr : LR updated to `8.364207e-05` 2019-11-15 23:08:48.346: INFO @log_profile : T train: 43.764694 2019-11-15 23:08:48.346: INFO @log_profile : T valid: 1.300380 2019-11-15 23:08:48.346: INFO @log_profile : T read data: 33.385479 2019-11-15 23:08:48.346: INFO @log_profile : T hooks: 100.450614 2019-11-15 23:08:48.346: INFO @main_loop : Epoch 495 done 2019-11-15 23:08:48.346: INFO @main_loop : Training epoch 496 2019-11-15 23:10:14.801: INFO @log_variables: train loss nanmean: 0.031809 2019-11-15 23:10:14.801: INFO @log_variables: train positive_distance nanmean: 0.552872 2019-11-15 23:10:14.802: INFO @log_variables: train negative_distance nanmean: 1.419454 2019-11-15 23:10:14.802: INFO @log_variables: valid loss nanmean: 0.274460 2019-11-15 23:10:14.802: INFO @log_variables: valid positive_distance nanmean: 0.682806 2019-11-15 23:10:14.802: INFO @log_variables: valid negative_distance nanmean: 1.400633 2019-11-15 23:10:14.802: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 23:11:46.208: INFO @metrics_hook: train matching accuracy: 0.9917534722222222, N=110592, DB_SIZE=110592, N_IDS=7319 2019-11-15 23:11:46.932: INFO @metrics_hook: valid matching accuracy: 0.9866695105044258, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 23:11:47.084: INFO @evaluate_embedding: best threshold 1.0417198836803436 2019-11-15 23:11:47.148: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 23:11:47.148: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 23:11:47.338: INFO @decay_lr : LR updated to `8.3223866e-05` 2019-11-15 23:11:47.339: INFO @log_profile : T train: 42.818774 2019-11-15 23:11:47.339: INFO @log_profile : T valid: 1.296842 2019-11-15 23:11:47.339: INFO @log_profile : T read data: 37.271104 2019-11-15 23:11:47.339: INFO @log_profile : T hooks: 97.538874 2019-11-15 23:11:47.339: INFO @main_loop : Epoch 496 done 2019-11-15 23:11:47.339: INFO @main_loop : Training epoch 497 2019-11-15 23:13:10.496: INFO @log_variables: train loss nanmean: 0.031848 2019-11-15 23:13:10.497: INFO @log_variables: train positive_distance nanmean: 0.553169 2019-11-15 23:13:10.497: INFO @log_variables: train negative_distance nanmean: 1.419462 2019-11-15 23:13:10.497: INFO @log_variables: valid loss nanmean: 0.275426 2019-11-15 23:13:10.497: INFO @log_variables: valid positive_distance nanmean: 0.682832 2019-11-15 23:13:10.497: INFO @log_variables: valid negative_distance nanmean: 1.400396 2019-11-15 23:13:10.497: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 23:14:43.510: INFO @metrics_hook: train matching accuracy: 0.9924587673611112, N=110592, DB_SIZE=110592, N_IDS=7304 2019-11-15 23:14:44.368: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 23:14:44.518: INFO @evaluate_embedding: best threshold 1.041613966226578 2019-11-15 23:14:44.581: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 23:14:44.581: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 23:14:44.786: INFO @decay_lr : LR updated to `8.280775e-05` 2019-11-15 23:14:44.788: INFO @log_profile : T train: 42.795656 2019-11-15 23:14:44.788: INFO @log_profile : T valid: 1.302856 2019-11-15 23:14:44.788: INFO @log_profile : T read data: 33.861155 2019-11-15 23:14:44.788: INFO @log_profile : T hooks: 99.419398 2019-11-15 23:14:44.788: INFO @main_loop : Epoch 497 done 2019-11-15 23:14:44.788: INFO @main_loop : Training epoch 498 2019-11-15 23:16:09.331: INFO @log_variables: train loss nanmean: 0.032437 2019-11-15 23:16:09.332: INFO @log_variables: train positive_distance nanmean: 0.554051 2019-11-15 23:16:09.332: INFO @log_variables: train negative_distance nanmean: 1.419448 2019-11-15 23:16:09.332: INFO @log_variables: valid loss nanmean: 0.274546 2019-11-15 23:16:09.332: INFO @log_variables: valid positive_distance nanmean: 0.682457 2019-11-15 23:16:09.332: INFO @log_variables: valid negative_distance nanmean: 1.400601 2019-11-15 23:16:09.332: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 23:17:41.653: INFO @metrics_hook: train matching accuracy: 0.9923864293981481, N=110592, DB_SIZE=110592, N_IDS=7314 2019-11-15 23:17:42.350: INFO @metrics_hook: valid matching accuracy: 0.9873093740002132, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 23:17:42.508: INFO @evaluate_embedding: best threshold 1.0415292978286745 2019-11-15 23:17:42.578: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 23:17:42.578: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 23:17:42.749: INFO @decay_lr : LR updated to `8.239371e-05` 2019-11-15 23:17:42.751: INFO @log_profile : T train: 42.932162 2019-11-15 23:17:42.751: INFO @log_profile : T valid: 1.289088 2019-11-15 23:17:42.751: INFO @log_profile : T read data: 35.199894 2019-11-15 23:17:42.751: INFO @log_profile : T hooks: 98.474121 2019-11-15 23:17:42.751: INFO @main_loop : Epoch 498 done 2019-11-15 23:17:42.751: INFO @main_loop : Training epoch 499 2019-11-15 23:19:06.474: INFO @log_variables: train loss nanmean: 0.032132 2019-11-15 23:19:06.475: INFO @log_variables: train positive_distance nanmean: 0.552946 2019-11-15 23:19:06.475: INFO @log_variables: train negative_distance nanmean: 1.419454 2019-11-15 23:19:06.475: INFO @log_variables: valid loss nanmean: 0.274997 2019-11-15 23:19:06.475: INFO @log_variables: valid positive_distance nanmean: 0.681582 2019-11-15 23:19:06.475: INFO @log_variables: valid negative_distance nanmean: 1.400807 2019-11-15 23:19:06.475: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 23:20:40.784: INFO @metrics_hook: train matching accuracy: 0.9927570959662179, N=110591, DB_SIZE=110592, N_IDS=7312 2019-11-15 23:20:41.679: INFO @metrics_hook: valid matching accuracy: 0.986349578756532, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 23:20:41.845: INFO @evaluate_embedding: best threshold 1.0411944091320038 2019-11-15 23:20:41.910: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 23:20:41.910: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 23:20:42.098: INFO @decay_lr : LR updated to `8.1981736e-05` 2019-11-15 23:20:42.099: INFO @log_profile : T train: 43.821306 2019-11-15 23:20:42.099: INFO @log_profile : T valid: 1.299330 2019-11-15 23:20:42.099: INFO @log_profile : T read data: 33.458431 2019-11-15 23:20:42.099: INFO @log_profile : T hooks: 100.700634 2019-11-15 23:20:42.099: INFO @main_loop : Epoch 499 done 2019-11-15 23:20:42.099: INFO @main_loop : Training epoch 500 2019-11-15 23:22:06.990: INFO @log_variables: train loss nanmean: 0.032280 2019-11-15 23:22:06.990: INFO @log_variables: train positive_distance nanmean: 0.553736 2019-11-15 23:22:06.990: INFO @log_variables: train negative_distance nanmean: 1.419455 2019-11-15 23:22:06.990: INFO @log_variables: valid loss nanmean: 0.274284 2019-11-15 23:22:06.990: INFO @log_variables: valid positive_distance nanmean: 0.680918 2019-11-15 23:22:06.990: INFO @log_variables: valid negative_distance nanmean: 1.400728 2019-11-15 23:22:06.991: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind 2019-11-15 23:23:42.116: INFO @metrics_hook: train matching accuracy: 0.9914911701675543, N=110591, DB_SIZE=110592, N_IDS=7292 2019-11-15 23:23:43.144: INFO @metrics_hook: valid matching accuracy: 0.986882798336355, N=9377, DB_SIZE=9377, N_IDS=1468 2019-11-15 23:23:43.295: INFO @evaluate_embedding: best threshold 1.0408230423927307 2019-11-15 23:23:43.356: INFO @evaluate_embedding: positive_distances_above_threshold 0 2019-11-15 23:23:43.356: INFO @evaluate_embedding: negative_distances_bellow_threshold 0 2019-11-15 23:23:43.539: INFO @decay_lr : LR updated to `8.157183e-05` 2019-11-15 23:23:43.540: INFO @stop_after : EpochStopperHook triggered 2019-11-15 23:23:43.541: INFO @log_profile : T train: 43.080451 2019-11-15 23:23:43.541: INFO @log_profile : T valid: 1.327336 2019-11-15 23:23:43.541: INFO @log_profile : T read data: 35.535188 2019-11-15 23:23:43.541: INFO @log_profile : T hooks: 101.429370 2019-11-15 23:23:43.541: INFO @main_loop : Training terminated: Training terminated after epoch 500 2019-11-15 23:23:43.542: INFO @log_dir : Output dir: ./log/EmbeddingMiniMiniModel_loving-rosalind