{"id":1535,"date":"2024-10-02T10:12:09","date_gmt":"2024-10-02T08:12:09","guid":{"rendered":"https:\/\/guillaume-guerard.com\/?page_id=1535"},"modified":"2024-10-02T10:43:31","modified_gmt":"2024-10-02T08:43:31","slug":"chain-of-thought-prompting","status":"publish","type":"page","link":"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/chain-of-thought-prompting\/","title":{"rendered":"Chain-of-Thought Prompt"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-page\" data-elementor-id=\"1535\" class=\"elementor elementor-1535\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-d22702c elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"d22702c\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-top-column elementor-element elementor-element-ff5b41d\" data-id=\"ff5b41d\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-27e5906 elementor-align-justify elementor-widget elementor-widget-button\" data-id=\"27e5906\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/guillaume-guerard.com\/\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">Accueil<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-top-column elementor-element elementor-element-086f624\" data-id=\"086f624\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-5624efe elementor-align-justify elementor-widget elementor-widget-button\" data-id=\"5624efe\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/complex-systems-ai.com\/\" target=\"_blank\" rel=\"noopener\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">Data Science<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-c5e3073 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"c5e3073\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-b1b45ef\" data-id=\"b1b45ef\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-c3576ae elementor-widget elementor-widget-heading\" data-id=\"c3576ae\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Contenus de la page<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/chain-of-thought-prompting\/#Chain-of-Thought_Prompting_faire_une_chaine_de_pensee\" >Chain-of-Thought Prompting, faire une cha\u00eene de pens\u00e9e<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/chain-of-thought-prompting\/#Principe_de_la_chaine_de_pensee\" >Principe de la chaine de pens\u00e9e<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/chain-of-thought-prompting\/#Zero_Shot_CoT\" >Zero Shot CoT<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/chain-of-thought-prompting\/#Automatic_CoT\" >Automatic CoT<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/chain-of-thought-prompting\/#Golden_chain-of-thought\" >Golden chain-of-thought<\/a><\/li><\/ul><\/nav><\/div>\n<h2 class=\"elementor-heading-title elementor-size-default\"><span class=\"ez-toc-section\" id=\"Chain-of-Thought_Prompting_faire_une_chaine_de_pensee\"><\/span>Chain-of-Thought Prompting, faire une cha\u00eene de pens\u00e9e<span class=\"ez-toc-section-end\"><\/span><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-54d7846 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"54d7846\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-2f8667b\" data-id=\"2f8667b\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-3b8b6c5 elementor-widget elementor-widget-text-editor\" data-id=\"3b8b6c5\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>[Wei et al., 2022] ont introduit l&rsquo;incitation \u00e0 la cha\u00eene de pens\u00e9e (Chain-of-thought prompting) comme technique pour inciter les LLM \u00e0 r\u00e9pondre de mani\u00e8re \u00e0 faciliter des processus de raisonnement coh\u00e9rents et \u00e9tape par \u00e9tape. La principale contribution r\u00e9side dans la <a href=\"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/ecrire-une-proposition-de-recherche\/\">proposition<\/a> et l&rsquo;exploration de l&rsquo;incitation \u00e0 la cha\u00eene de pens\u00e9e, d\u00e9montrant son efficacit\u00e9 pour susciter des r\u00e9ponses plus structur\u00e9es et plus r\u00e9fl\u00e9chies de la part des LLM par rapport aux invites traditionnelles.<\/p><p><img decoding=\"async\" class=\"alignnone wp-image-49 size-full\" src=\"http:\/\/guillaume-guerard.com\/wp-content\/uploads\/2023\/07\/logo_sc.png\" alt=\"Chain-of-thought prompting\" width=\"238\" height=\"203\" \/><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-a1127bc elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"a1127bc\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-21cba4a\" data-id=\"21cba4a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-0731a60 elementor-widget elementor-widget-heading\" data-id=\"0731a60\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\"><span class=\"ez-toc-section\" id=\"Principe_de_la_chaine_de_pensee\"><\/span>Principe de la chaine de pens\u00e9e<span class=\"ez-toc-section-end\"><\/span><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-ba52a44 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"ba52a44\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-7001eca\" data-id=\"7001eca\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-940de0f elementor-widget elementor-widget-text-editor\" data-id=\"940de0f\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Introduite par Wei et al. (2022), la <a href=\"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/parfaire-la-methodologie\/\">m\u00e9thode<\/a> de la cha\u00eene de pens\u00e9e (CoT) permet de d\u00e9velopper des capacit\u00e9s de raisonnement complexes gr\u00e2ce \u00e0 des \u00e9tapes de raisonnement interm\u00e9diaires. Vous pouvez la combiner avec une m\u00e9thode de r\u00e9ponse en quelques \u00e9tapes pour obtenir de meilleurs <a href=\"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/parfaire-la-section-resultats\/\">r\u00e9sultats<\/a> sur des t\u00e2ches plus complexes qui n\u00e9cessitent un raisonnement avant de r\u00e9pondre.<\/p><p>\u00ab\u00a0Les nombres impairs de ce groupe s&rsquo;additionnent pour former un nombre pair : 4, 8, 9, 15, 12, 2, 1.<br \/>A : En additionnant tous les nombres impairs (9, 15, 1), on obtient 25. La r\u00e9ponse est Faux.<br \/>Les nombres impairs de ce groupe s&rsquo;additionnent pour former un nombre pair : 17, 10, 19, 4, 8, 12, 24.<br \/>A : En additionnant tous les nombres impairs (17, 19), on obtient 36. La r\u00e9ponse est Vrai.<br \/>Les nombres impairs de ce groupe s&rsquo;additionnent pour former un nombre pair : 16, 11, 14, 4, 8, 13, 24.<br \/>A : En additionnant tous les nombres impairs (11, 13), on obtient 24. La r\u00e9ponse est Vrai.<br \/>Les nombres impairs de ce groupe s&rsquo;additionnent pour former un nombre pair\u00a0: 17, 9, 10, 12, 13, 4, 2.<br \/>A\u00a0: En additionnant tous les nombres impairs (17, 9, 13), on obtient 39. La r\u00e9ponse est Faux.<br \/>Les nombres impairs de ce groupe s&rsquo;additionnent pour former un nombre pair\u00a0: 15, 32, 5, 13, 82, 7, 1.<br \/>A :\u00a0\u00bb<\/p><p>Le prompt g\u00e9n\u00e8re la r\u00e9ponse suivante :<\/p><p>\u00ab\u00a0L&rsquo;addition de tous les nombres impairs (15, 5, 13, 7, 1) donne 41. La r\u00e9ponse est Faux.\u00a0\u00bb<\/p><p>En soit un seul exemple de few-shot prompting suffit ici.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-ecb3057 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"ecb3057\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-b6abf18\" data-id=\"b6abf18\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-84bae05 elementor-widget elementor-widget-heading\" data-id=\"84bae05\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\"><span class=\"ez-toc-section\" id=\"Zero_Shot_CoT\"><\/span>Zero Shot CoT<span class=\"ez-toc-section-end\"><\/span><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-6c8838b elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"6c8838b\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-91c7ce9\" data-id=\"91c7ce9\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-02d5611 elementor-widget elementor-widget-text-editor\" data-id=\"02d5611\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Le concept d&rsquo;invite de \u00ab\u00a0cha\u00eene de pens\u00e9e Zero-Shot\u00a0\u00bb (Zero-shot-CoT) est une it\u00e9ration avanc\u00e9e du m\u00e9canisme d&rsquo;invite CoT, o\u00f9 l&rsquo;aspect \u00ab\u00a0z\u00e9ro-shot\u00a0\u00bb implique que le mod\u00e8le est capable d&rsquo;effectuer un certain raisonnement sans avoir vu des exemples de la t\u00e2che pendant la formation. L\u2019augmentation des requ\u00eates avec la phrase \u00ab\u00a0Pensons \u00e9tape par \u00e9tape\u00a0\u00bb a facilit\u00e9 la g\u00e9n\u00e9ration d\u2019une cha\u00eene de raisonnement s\u00e9quentielle par les LLM. Cette cha\u00eene de raisonnement s\u2019est ensuite r\u00e9v\u00e9l\u00e9e d\u00e9terminante pour obtenir des r\u00e9ponses plus pr\u00e9cises. Cette technique est bas\u00e9e sur l&rsquo;id\u00e9e que le mod\u00e8le, tout comme un humain, peut b\u00e9n\u00e9ficier d&rsquo;\u00e9tapes plus d\u00e9taill\u00e9es et logiques pour traiter l&rsquo;invite et g\u00e9n\u00e9rer une r\u00e9ponse.<\/p><p><img fetchpriority=\"high\" decoding=\"async\" class=\"alignnone wp-image-1541 size-full\" src=\"http:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/zero-cot.webp\" alt=\"zero shot chain of thought prompting\" width=\"944\" height=\"508\" srcset=\"https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/zero-cot.webp 944w, https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/zero-cot-300x161.webp 300w, https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/zero-cot-768x413.webp 768w, https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/zero-cot-18x10.webp 18w\" sizes=\"(max-width: 944px) 100vw, 944px\" \/><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-fc9a5cb elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"fc9a5cb\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-788c59f\" data-id=\"788c59f\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7c187b4 elementor-widget elementor-widget-heading\" data-id=\"7c187b4\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\"><span class=\"ez-toc-section\" id=\"Automatic_CoT\"><\/span>Automatic CoT<span class=\"ez-toc-section-end\"><\/span><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-6053bb7 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"6053bb7\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-5d5a433\" data-id=\"5d5a433\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-5d2fe2e elementor-widget elementor-widget-text-editor\" data-id=\"5d2fe2e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Lors de l\u2019application d\u2019incitations en cha\u00eene de pens\u00e9e avec des d\u00e9monstrations, le processus implique la cr\u00e9ation manuelle d\u2019exemples efficaces et diversifi\u00e9s. Cet effort manuel pourrait conduire \u00e0 des solutions sous-optimales. Zhang et coll. (2022) proposent une approche pour \u00e9liminer les efforts manuels en tirant parti des LLM avec l&rsquo;invite \u00ab\u00a0Pensons \u00e9tape par \u00e9tape\u00a0\u00bb pour g\u00e9n\u00e9rer des cha\u00eenes de raisonnement pour les d\u00e9monstrations une par une. Ce processus automatique peut encore aboutir \u00e0 des erreurs dans les cha\u00eenes g\u00e9n\u00e9r\u00e9es. Pour att\u00e9nuer les effets des erreurs, la diversit\u00e9 des manifestations compte. Ce travail propose Auto-CoT, qui \u00e9chantillonne des <a href=\"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/definir-les-questions-scientifiques\/\">questions<\/a> avec diversit\u00e9 et g\u00e9n\u00e8re des cha\u00eenes de raisonnement pour construire les d\u00e9monstrations.<\/p><p>Auto-CoT se compose de deux \u00e9tapes principales\u00a0:<\/p><ol><li>Regroupement de questions\u00a0: partitionner les questions d&rsquo;un ensemble de donn\u00e9es donn\u00e9 en quelques clusters<\/li><li>\u00c9chantillonnage de d\u00e9monstration : s\u00e9lectionnez une question repr\u00e9sentative de chaque cluster et g\u00e9n\u00e9rez sa cha\u00eene de raisonnement \u00e0 l&rsquo;aide de Zero-Shot-CoT avec des heuristiques simples<\/li><\/ol><p>L&rsquo;heuristique simple pourrait \u00eatre la longueur des questions (par exemple, 60 jetons) et le nombre d&rsquo;\u00e9tapes de la justification (par exemple, 5 \u00e9tapes de raisonnement). Cela encourage le mod\u00e8le \u00e0 utiliser des d\u00e9monstrations simples et pr\u00e9cises.<\/p><p><img decoding=\"async\" class=\"alignnone wp-image-1542 size-large\" src=\"http:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/auto-cot-1024x558.webp\" alt=\"automatic chain of thought prompting\" width=\"1024\" height=\"558\" srcset=\"https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/auto-cot-1024x558.webp 1024w, https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/auto-cot-300x163.webp 300w, https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/auto-cot-768x418.webp 768w, https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/auto-cot-18x10.webp 18w, https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/auto-cot.webp 1113w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-908aa87 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"908aa87\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-aeb20e8\" data-id=\"aeb20e8\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-edabe22 elementor-widget elementor-widget-heading\" data-id=\"edabe22\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\"><span class=\"ez-toc-section\" id=\"Golden_chain-of-thought\"><\/span>Golden chain-of-thought<span class=\"ez-toc-section-end\"><\/span><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-298322c elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"298322c\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-3b6a3b6\" data-id=\"3b6a3b6\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-0aa58f7 elementor-widget elementor-widget-text-editor\" data-id=\"0aa58f7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>La cha\u00eene de pens\u00e9e en or fournit une approche innovante pour g\u00e9n\u00e9rer des r\u00e9ponses aux requ\u00eates bas\u00e9es sur des instructions. Cette <a href=\"https:\/\/guillaume-guerard.com\/en\/cours-de-methodologie\/\">m\u00e9thodologie<\/a> exploite un ensemble de solutions de \u00ab cha\u00eene de pens\u00e9e fond\u00e9e sur la v\u00e9rit\u00e9 terrain \u00bb incorpor\u00e9es dans l&rsquo;invite, simplifiant consid\u00e9rablement la t\u00e2che du mod\u00e8le car elle \u00e9vite la n\u00e9cessit\u00e9 d&rsquo;une g\u00e9n\u00e9ration ind\u00e9pendante de CoT. Parall\u00e8lement, un nouveau benchmark comprenant des \u00e9nigmes polici\u00e8res a \u00e9t\u00e9 con\u00e7u, pour \u00e9valuer les capacit\u00e9s de raisonnement abductif des LLM, qui est \u00e9galement consid\u00e9r\u00e9 comme une \u00e9valuation du Golden CoT. GPT-4 pr\u00e9sente des performances louables, avec un taux de r\u00e9solution d&rsquo;\u00e9nigmes de 83 %, contrairement au taux de r\u00e9solution de 38 % du CoT standard.<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-1543 size-full\" src=\"http:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/golden-cot.png\" alt=\"golden-cot\" width=\"641\" height=\"393\" srcset=\"https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/golden-cot.png 641w, https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/golden-cot-300x184.png 300w, https:\/\/guillaume-guerard.com\/wp-content\/uploads\/2024\/10\/golden-cot-18x12.png 18w\" sizes=\"(max-width: 641px) 100vw, 641px\" \/><\/p><p>Ensuite, nous ajoutons toujours le nom du myst\u00e8re, la liste des suspects et le contenu myst\u00e8re (corps) \u00e0 l&rsquo;invite. Lorsque nous souhaitons invoquer le raisonnement en cha\u00eene de r\u00e9flexion, nous ajoutons \u00e9galement ce qui suit\u00a0:<\/p><p>R\u00e9ponse compl\u00e8te :<br \/>R\u00e9fl\u00e9chissons \u00e9tape par \u00e9tape.<\/p><p>Lorsque nous souhaitons fournir une cha\u00eene de pens\u00e9e dor\u00e9e, nous ajoutons l&rsquo;invite suivante\u00a0:<\/p><p>Solution\u00a0: {solution}<\/p><p>Enfin, nous demandons toujours la r\u00e9ponse finale avec<\/p><p>R\u00e9ponse finale :<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Accueil Data Science Chain-of-Thought Prompting, faire une cha\u00eene de pens\u00e9e [Wei et al., 2022] ont introduit l&rsquo;incitation \u00e0 la cha\u00eene &hellip; <\/p>\n","protected":false},"author":1,"featured_media":0,"parent":47,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"elementor_header_footer","meta":{"footnotes":""},"class_list":["post-1535","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/guillaume-guerard.com\/en\/wp-json\/wp\/v2\/pages\/1535","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/guillaume-guerard.com\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/guillaume-guerard.com\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/guillaume-guerard.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/guillaume-guerard.com\/en\/wp-json\/wp\/v2\/comments?post=1535"}],"version-history":[{"count":10,"href":"https:\/\/guillaume-guerard.com\/en\/wp-json\/wp\/v2\/pages\/1535\/revisions"}],"predecessor-version":[{"id":1552,"href":"https:\/\/guillaume-guerard.com\/en\/wp-json\/wp\/v2\/pages\/1535\/revisions\/1552"}],"up":[{"embeddable":true,"href":"https:\/\/guillaume-guerard.com\/en\/wp-json\/wp\/v2\/pages\/47"}],"wp:attachment":[{"href":"https:\/\/guillaume-guerard.com\/en\/wp-json\/wp\/v2\/media?parent=1535"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}