{"id":2589,"date":"2026-09-24T15:22:15","date_gmt":"2026-09-24T15:22:15","guid":{"rendered":"https:\/\/prlalmeida.com.br\/dsbd\/?page_id=2589"},"modified":"2026-09-25T12:36:40","modified_gmt":"2026-09-25T12:36:40","slug":"optimtrain","status":"publish","type":"page","link":"https:\/\/prlalmeida.com.br\/dsbd\/optimtrain\/","title":{"rendered":"OptimTrain"},"content":{"rendered":"\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Optimizations in metric learning model training<\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
\n\t\t
\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Researchers<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t
\"\"<\/figure>

Paulo R. Lisboa de Almeida<\/h3>

UFPR<\/p><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t
\"\"<\/figure>

Andr\u00e9 Gr\u00e9gio<\/h3>

UFPR<\/p><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t
\"\"<\/figure>

Roberto Tomchak<\/h3>

UFPR<\/p><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t
\"\"<\/figure>

Helo\u00edsa Viotto<\/h3>

UFPR<\/p><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t
\"\"<\/figure>

Cau\u00ea Samonek<\/h3>

UFPR<\/p><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t
\n\t\t\t\t\t
\"\"<\/figure>

Thamiris Yamate Fischer<\/h3>

UFPR<\/p><\/div><\/div>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

\n\t\t
\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Maintaining Difficulty: A Margin Scheduler for Triplet Loss in Siamese Networks Training<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

This study reveals that, during the training of Siamese Networks using Triplet Margin Ranking Loss, the effective margin is often higher than the hyperparameter’s preset value, which can limit learning. The paper then suggests adapting this value during training; however, unlike previous approaches that focus on specific scenarios, the authors propose adjusting the margin based on the ratio of easy triplets.<\/p>

In experiments conducted on the LFW, CelebA, CUB-200-2011, and Stanford Cars datasets, the effectiveness of a fixed margin of m = 0.3<\/span>\u00a0was compared against two methods: the proposed Linear Scheduler, which starts with an initial margin of m0 = 0.0<\/span>\u00a0and a growth rate per epoch of sl = 0.01<\/span>; and the Difficulty Adaptive Margin Scheduler (DAMS), which also starts with an initial margin of m0 = 0.0<\/span>, but applies a growth rate of sa = 0.01<\/span>\u00a0only in epochs where the ratio of easy triplets exceeds a threshold of t = 0.95<\/span>. These hyperparameters were selected based on exhaustive testing across multiple configurations.<\/p>

The results indicate that DAMS is the most suitable method in most scenarios, as its margin growth can plateau at a certain point during training, unlike the linear method, which can be overly aggressive, or the fixed margin, which fails to adapt to the problem.<\/p>

This work, titled “Maintaining Difficulty: A Margin Scheduler for Triplet Loss in Siamese Network Training<\/span><\/strong><\/span><\/a>” was presented at IJCNN 2026.<\/p>

<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

\n\t\t
\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

How Far is Too Far? Defining the Distance\nThreshold for Verification Siamese Networks.<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

In Siamese Networks, two objects are considered to belong to the same class if the distance between them falls below a predefined threshold. This paper proposes determining the threshold (t<\/span><\/span><\/span><\/span><\/span>) for each problem by assuming that the distribution of distances can be approximated by a bimodal function. In this scenario, t<\/span><\/span><\/span><\/span><\/span> is the local minimum between the two modes: positive pairs concentrated at smaller distances and negative pairs at larger ones. Unlike other methods, such as selecting this hyperparameter based on ROC curve analysis, the proposed approach does not require pre-labeled data and is robust against distribution shifts between training, validation, and test sets. Furthermore, the technique performs well on imbalanced data.<\/p>

The paper presents two algorithms: BimodalVal<\/b>, which estimates the threshold using only the validation dataset, and BimodalUpd<\/b>, where t<\/span><\/span><\/span><\/span><\/span> is initialized based on the validation data but can adapt every 64 new distances observed during testing. In experiments conducted on the MNIST, CIFAR10, PKLot, and LFW datasets, these two algorithms were compared against a fixed threshold baseline and the Equal Error Rate (EER) method. The results demonstrate that both proposed algorithms and EER achieve similar accuracy, significantly outperforming the fixed threshold approach.<\/p>

This work, titled “How Far is Too Far? Defining the Distance Threshold for Verification Siamese Networks”<\/strong><\/a><\/span>, was presented at SMC 2026.<\/p><\/div><\/div>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

Optimizations in metric learning model training Researchers Paulo R. Lisboa de Almeida UFPR Andr\u00e9 Gr\u00e9gio UFPR Roberto Tomchak UFPR Helo\u00edsa […]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"elementor_header_footer","meta":{"site-sidebar-layout":"no-sidebar","site-content-layout":"","ast-site-content-layout":"full-width-container","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"disabled","ast-breadcrumbs-content":"","ast-featured-img":"disabled","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"class_list":["post-2589","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/prlalmeida.com.br\/dsbd\/wp-json\/wp\/v2\/pages\/2589","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prlalmeida.com.br\/dsbd\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/prlalmeida.com.br\/dsbd\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/prlalmeida.com.br\/dsbd\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prlalmeida.com.br\/dsbd\/wp-json\/wp\/v2\/comments?post=2589"}],"version-history":[{"count":20,"href":"https:\/\/prlalmeida.com.br\/dsbd\/wp-json\/wp\/v2\/pages\/2589\/revisions"}],"predecessor-version":[{"id":2632,"href":"https:\/\/prlalmeida.com.br\/dsbd\/wp-json\/wp\/v2\/pages\/2589\/revisions\/2632"}],"wp:attachment":[{"href":"https:\/\/prlalmeida.com.br\/dsbd\/wp-json\/wp\/v2\/media?parent=2589"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}