{"id":401926,"date":"2025-12-30T11:11:55","date_gmt":"2025-12-30T18:11:55","guid":{"rendered":"https:\/\/barrazacarlos.com\/free-robots-txt-generator\/"},"modified":"2025-12-30T11:12:06","modified_gmt":"2025-12-30T18:12:06","slug":"free-robots-txt-generator","status":"publish","type":"page","link":"https:\/\/barrazacarlos.com\/pt-br\/free-robots-txt-generator\/","title":{"rendered":"Gerador gratuito de Robots.txt (SEO-Safe + Controle de rastreamento de IA)"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-page\" data-elementor-id=\"401926\" class=\"elementor elementor-401926 elementor-400576\" data-elementor-post-type=\"page\">\n\t\t\t\t\t\t<main class=\"elementor-section elementor-top-section elementor-element elementor-element-23bfe264 elementor-section-height-min-height elementor-section-content-bottom elementor-section-boxed elementor-section-height-default elementor-section-items-middle\" data-id=\"23bfe264\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t\t<div class=\"elementor-background-overlay\"><\/div>\n\t\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-wider\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-619cb1bc\" data-id=\"619cb1bc\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-564894ed elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"564894ed\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-23e29665\" data-id=\"23e29665\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-1f79b8e3 elementor-widget elementor-widget-heading\" data-id=\"1f79b8e3\" data-element_type=\"widget\" data-e-type=\"widget\" data-settings=\"{&quot;_animation&quot;:&quot;none&quot;,&quot;_animation_delay&quot;:&quot;800&quot;}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h1 class=\"elementor-heading-title elementor-size-default\">Gerador gratuito de Robots.txt (SEO-Safe + Controle de rastreamento de IA)<\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-70a5da2c elementor-widget elementor-widget-heading\" data-id=\"70a5da2c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span class=\"elementor-heading-title elementor-size-default\">Escrito por<\/span>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-642f6018 elementor-align-left elementor-widget elementor-widget-post-info\" data-id=\"642f6018\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"post-info.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ul class=\"elementor-inline-items elementor-icon-list-items elementor-post-info\">\n\t\t\t\t\t\t\t\t<li class=\"elementor-icon-list-item elementor-repeater-item-ef43aea elementor-inline-item\" itemprop=\"author\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text elementor-post-info__item elementor-post-info__item--type-author\">\n\t\t\t\t\t\t\t\t\t\tRedaction Team\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t<li class=\"elementor-icon-list-item elementor-repeater-item-476dca5 elementor-inline-item\" itemprop=\"datePublished\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text elementor-post-info__item elementor-post-info__item--type-date\">\n\t\t\t\t\t\t\t\t\t\t<time>dezembro 30, 2025<\/time>\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t<\/ul>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5c576898 elementor-widget elementor-widget-text-editor\" data-id=\"5c576898\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"371\" data-end=\"608\">Use nosso <strong data-start=\"379\" data-end=\"408\">gerador gratuito de robots.txt<\/strong> para <strong data-start=\"412\" data-end=\"450\">criar instantaneamente um arquivo robots.txt<\/strong> que ajude <strong data-start=\"462\" data-end=\"536\">o Google e outros mecanismos de pesquisa a rastrear e indexar seu site corretamente<\/strong>, sem desperdi\u00e7ar o or\u00e7amento de rastreamento ou expor partes sens\u00edveis do seu site.<\/p><p data-start=\"610\" data-end=\"825\">Essa <strong data-start=\"615\" data-end=\"635\">ferramenta f\u00e1cil de usar<\/strong> gera <strong data-start=\"646\" data-end=\"693\">arquivos robots.txt eficazes para o seu site<\/strong>, seguindo o <strong data-start=\"709\" data-end=\"794\">protocolo de exclus\u00e3o de rob\u00f4s (tamb\u00e9m chamado de protocolo ou padr\u00e3o de exclus\u00e3o de rob\u00f4s)<\/strong> e as pr\u00e1ticas recomendadas modernas de SEO.<\/p><p data-start=\"827\" data-end=\"993\">Se voc\u00ea deseja <strong data-start=\"847\" data-end=\"938\">permitir ou impedir que os rastreadores acessem URLs, pastas, diret\u00f3rios ou p\u00e1ginas espec\u00edficos<\/strong>, este <strong data-start=\"945\" data-end=\"969\">gerador de rob\u00f4s txt<\/strong> ajuda voc\u00ea a fazer isso com seguran\u00e7a.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-761c4a6c\" data-id=\"761c4a6c\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-2adebe2e elementor-widget elementor-widget-image\" data-id=\"2adebe2e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"1280\" height=\"720\" src=\"https:\/\/barrazacarlos.com\/wp-content\/uploads\/2025\/12\/Free-Robots.txt-Generator.webp\" class=\"attachment-full size-full wp-image-400588\" alt=\"Free Robots.txt Generator\" srcset=\"https:\/\/barrazacarlos.com\/wp-content\/uploads\/2025\/12\/Free-Robots.txt-Generator.webp 1280w, https:\/\/barrazacarlos.com\/wp-content\/uploads\/2025\/12\/Free-Robots.txt-Generator-300x169.webp 300w, https:\/\/barrazacarlos.com\/wp-content\/uploads\/2025\/12\/Free-Robots.txt-Generator-1024x576.webp 1024w, https:\/\/barrazacarlos.com\/wp-content\/uploads\/2025\/12\/Free-Robots.txt-Generator-768x432.webp 768w\" sizes=\"(max-width: 1280px) 100vw, 1280px\" title=\"\">\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-84b5082 elementor-toc--minimized-on-desktop elementor-widget elementor-widget-table-of-contents\" data-id=\"84b5082\" data-element_type=\"widget\" data-e-type=\"widget\" data-settings=\"{&quot;headings_by_tags&quot;:[&quot;h2&quot;],&quot;exclude_headings_by_selector&quot;:[],&quot;collapse_subitems&quot;:&quot;yes&quot;,&quot;no_headings_message&quot;:&quot;No headings were found on this page.&quot;,&quot;minimized_on&quot;:&quot;desktop&quot;,&quot;marker_view&quot;:&quot;numbers&quot;,&quot;minimize_box&quot;:&quot;yes&quot;,&quot;hierarchical_view&quot;:&quot;yes&quot;,&quot;min_height&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]},&quot;min_height_tablet&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]},&quot;min_height_mobile&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"table-of-contents.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-toc__header\">\n\t\t\t\t\t\t<div class=\"elementor-toc__header-title\">\n\t\t\t\t\u00cdndice\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t<div class=\"elementor-toc__toggle-button elementor-toc__toggle-button--expand\" role=\"button\" tabindex=\"0\" aria-controls=\"elementor-toc__84b5082\" aria-expanded=\"true\" aria-label=\"Abrir Tabela de Conte\u00fados\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 448 512\"><path d=\"M207.029 381.476L12.686 187.132c-9.373-9.373-9.373-24.569 0-33.941l22.667-22.667c9.357-9.357 24.522-9.375 33.901-.04L224 284.505l154.745-154.021c9.379-9.335 24.544-9.317 33.901.04l22.667 22.667c9.373 9.373 9.373 24.569 0 33.941L240.971 381.476c-9.373 9.372-24.569 9.372-33.942 0z\"><\/path><\/svg><\/div>\n\t\t\t\t<div class=\"elementor-toc__toggle-button elementor-toc__toggle-button--collapse\" role=\"button\" tabindex=\"0\" aria-controls=\"elementor-toc__84b5082\" aria-expanded=\"true\" aria-label=\"Fechar Tabela de Conte\u00fados\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 448 512\"><path d=\"M240.971 130.524l194.343 194.343c9.373 9.373 9.373 24.569 0 33.941l-22.667 22.667c-9.357 9.357-24.522 9.375-33.901.04L224 227.495 69.255 381.516c-9.379 9.335-24.544 9.317-33.901-.04l-22.667-22.667c-9.373-9.373-9.373-24.569 0-33.941L207.03 130.525c9.372-9.373 24.568-9.373 33.941-.001z\"><\/path><\/svg><\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<div id=\"elementor-toc__84b5082\" class=\"elementor-toc__body elementor-toc__list-items--collapsible\">\n\t\t\t<div class=\"elementor-toc__spinner-container\">\n\t\t\t\t<svg class=\"elementor-toc__spinner eicon-animation-spin e-font-icon-svg e-eicon-loading\" aria-hidden=\"true\" viewBox=\"0 0 1000 1000\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\"><path d=\"M500 975V858C696 858 858 696 858 500S696 142 500 142 142 304 142 500H25C25 237 238 25 500 25S975 237 975 500 763 975 500 975Z\"><\/path><\/svg>\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-1574994 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"1574994\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-89c087c\" data-id=\"89c087c\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-2848f36 elementor-widget elementor-widget-heading\" data-id=\"2848f36\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Gerador gratuito de arquivos robots.txt<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-cd4ce4f elementor-widget elementor-widget-html\" data-id=\"cd4ce4f\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div id=\"robots-generator\" style=\"max-width:950px;font-family:system-ui,sans-serif\">\r\n\r\n  <!-- DIRECTORIES -->\r\n  <h3>Bloquear diret\u00f3rios confidenciais<\/h3>\r\n  <label><input type=\"checkbox\" value=\"\/wp-admin\/\">  \/wp-admin\/ (alto impacto na CPU)<\/label><br>  <label><input type=\"checkbox\" value=\"\/wp-includes\/\">  \/wp-includes\/ (impacto m\u00e9dio na CPU)<\/label><br>  <label><input type=\"checkbox\" value=\"\/cgi-bin\/\">  \/cgi-bin\/ (baixo impacto na CPU)<\/label><br><br>\r\n  <label>\r\n    <input type=\"checkbox\" id=\"allowAjax\">\r\n  Permitir \/wp-admin\/admin-ajax.php\r\n  <\/label><br><br>\r\n  <!-- SEARCH CRAWLERS -->\r\n  <h3>Rastreadores de mecanismos de pesquisa (Padr\u00e3o: Permitir)<\/h3>\r\n  <small>Selecione um rastreador para bloque\u00e1-lo<\/small><br><br>\r\n  <div style=\"columns:2\">\r\n    <label><input type=\"checkbox\" data-agent=\"Googlebot\">  Google<\/label><br>    <label><input type=\"checkbox\" data-agent=\"bingbot\">  Bing<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Slurp\">  Yahoo<\/label><br>    <label><input type=\"checkbox\" data-agent=\"DuckDuckBot\">  DuckDuckGo<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Baiduspider\">  Baidu<\/label><br>    <label><input type=\"checkbox\" data-agent=\"YandexBot\">  Yandex<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Applebot\">  Apple<\/label><br>    <label><input type=\"checkbox\" data-agent=\"NaverBot\">  Naver<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Teoma\">  Pergunte \/ Teoma<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Gigabot\">  GigaBlast<\/label><br>    <label><input type=\"checkbox\" data-agent=\"msnbot\">  Pesquisa MSN<\/label><br>    <label><input type=\"checkbox\" data-agent=\"msnbot-media\">  MSN PicSearch<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Googlebot-Image\">  Imagens do Google<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Googlebot-Mobile\">  Google Mobile<\/label><br>  <\/div>\r\n\r\n  <!-- OTHER KNOWN CRAWLERS -->\r\n  <h3>Rastreadores de SEO e utilit\u00e1rios (Padr\u00e3o: Permitir)<\/h3>\r\n  <div style=\"columns:2\">\r\n    <label><input type=\"checkbox\" data-agent=\"AhrefsBot\">  Ahrefs<\/label><br>    <label><input type=\"checkbox\" data-agent=\"SemrushBot\">  Semrush<\/label><br>    <label><input type=\"checkbox\" data-agent=\"MJ12bot\">  Majestoso<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Mozbot\">  Moz<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Screaming Frog SEO Spider\">  R\u00e3 gritando<\/label><br>    <label><input type=\"checkbox\" data-agent=\"CCBot\">  Rastreamento comum<\/label><br>    <label><input type=\"checkbox\" data-agent=\"ia_archiver\">  Alexa \/ Wayback<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Pinterestbot\">  Pinterest<\/label><br>    <label><input type=\"checkbox\" data-agent=\"facebookexternalhit\">  Facebook<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Twitterbot\">  Twitter<\/label><br>  <\/div>\r\n\r\n  <!-- AI CRAWLERS -->\r\n  <h3>Rastreadores de IA e bots de treinamento do LLM (Padr\u00e3o: Permitir)<\/h3>\r\n  <small>O bloqueio desses itens pode reduzir a carga do servidor e o uso de dados<\/small><br><br>\r\n  <div style=\"columns:2\">\r\n    <label><input type=\"checkbox\" data-agent=\"GPTBot\">  OpenAI (GPTBot) - Alto impacto na CPU<\/label><br>    <label><input type=\"checkbox\" data-agent=\"ChatGPT-User\">  Usu\u00e1rio do ChatGPT<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Google-Extended\">  IA do Google (SGE \/ Gemini)<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Meta-ExternalAgent\">  Meta IA<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Applebot-Extended\">  IA da Apple<\/label><br>    <label><input type=\"checkbox\" data-agent=\"PerplexityBot\">  IA de perplexidade<\/label><br>    <label><input type=\"checkbox\" data-agent=\"ClaudeBot\">  Antr\u00f3pico \/ Claude<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Bytespider\">  TikTok \/ ByteDance AI<\/label><br>  <\/div>\r\n\r\n  <!-- OPTIONS -->\r\n  <h3>Configura\u00e7\u00f5es opcionais<\/h3>\r\n  <label>Atraso de rastreamento (segundos)<\/label><br>  <input type=\"number\" id=\"crawlDelay\" min=\"0\"><br><br>\r\n  <label>URL do mapa do site<\/label><br>  <input type=\"url\" id=\"sitemapUrl\" placeholder=\"https:\/\/example.com\/sitemap.xml\" style=\"width:100%\"><br><br>\r\n  <button onclick=\"generateRobots()\" style=\"padding:10px 20px;font-weight:bold\">\r\n  Gerar o arquivo robots.txt\r\n  <\/button>\r\n\r\n  <button onclick=\"downloadRobots()\" style=\"padding:10px 20px;font-weight:bold;margin-left:10px\">\r\n  Baixe o arquivo robots.txt\r\n  <\/button>\r\n\r\n  <h3>Robots.txt gerados<\/h3>\r\n  <textarea id=\"output\" rows=\"20\" style=\"width:100%;font-family:monospace\"><\/textarea>\r\n<\/div>\r\n\r\n<script>\r\nfunction generateRobots() {\r\n  let output = [];\r\n  output.push(\"User-agent: *\");\r\n\r\n  document.querySelectorAll('#robots-generator input[type=\"checkbox\"]:checked').forEach(cb => {\r\n    if (cb.value && !cb.dataset.agent && cb.id !== \"allowAjax\") {\r\n      output.push(\"Disallow: \" + cb.value);\r\n    }\r\n  });\r\n\r\n  if (document.getElementById(\"allowAjax\").checked) {\r\n    output.push(\"Allow: \/wp-admin\/admin-ajax.php\");\r\n  }\r\n\r\n  let delay = document.getElementById(\"crawlDelay\").value;\r\n  if (delay) {\r\n    output.push(\"Crawl-delay: \" + delay);\r\n  }\r\n\r\n  document.querySelectorAll('#robots-generator input[data-agent]:checked').forEach(cb => {\r\n    output.push(\"\");\r\n    output.push(\"User-agent: \" + cb.dataset.agent);\r\n    output.push(\"Disallow: \/\");\r\n  });\r\n\r\n  let sitemap = document.getElementById(\"sitemapUrl\").value;\r\n  if (sitemap) {\r\n    output.push(\"\");\r\n    output.push(\"Sitemap: \" + sitemap);\r\n  }\r\n\r\n  document.getElementById(\"output\").value = output.join(\"\\n\");\r\n}\r\n\r\nfunction downloadRobots() {\r\n  const content = document.getElementById(\"output\").value;\r\n  if (!content) {\r\n    alert(\"Please generate the robots.txt file first.\");\r\n    return;\r\n  }\r\n\r\n  const blob = new Blob([content], { type: \"text\/plain\" });\r\n  const url = URL.createObjectURL(blob);\r\n\r\n  const a = document.createElement(\"a\");\r\n  a.href = url;\r\n  a.download = \"robots.txt\";\r\n  document.body.appendChild(a);\r\n  a.click();\r\n\r\n  document.body.removeChild(a);\r\n  URL.revokeObjectURL(url);\r\n}\r\n<\/script>\r\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-1cc93a8b elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"1cc93a8b\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-10e15af5\" data-id=\"10e15af5\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-42f573c1 elementor-widget elementor-widget-heading\" data-id=\"42f573c1\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">O que \u00e9 um arquivo robots.txt?<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-362f6567 elementor-widget elementor-widget-text-editor\" data-id=\"362f6567\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"1031\" data-end=\"1191\">Um <strong data-start=\"1033\" data-end=\"1052\">arquivo robots.txt<\/strong> \u00e9 um <strong data-start=\"1058\" data-end=\"1071\">arquivo de texto<\/strong> colocado na <strong data-start=\"1086\" data-end=\"1117\">pasta raiz do seu site<\/strong> que informa ao <strong data-start=\"1131\" data-end=\"1156\">rastreador do mecanismo de pesquisa<\/strong> como ele pode <strong data-start=\"1168\" data-end=\"1190\">rastrear seu site<\/strong>.<\/p><p data-start=\"1193\" data-end=\"1228\">Em termos simples, um <strong data-start=\"1212\" data-end=\"1227\">arquivo de rob\u00f4s<\/strong>:<\/p><ul data-start=\"1229\" data-end=\"1520\"><li data-start=\"1229\" data-end=\"1309\"><p data-start=\"1231\" data-end=\"1309\">Informa aos <strong data-start=\"1237\" data-end=\"1309\">mecanismos de pesquisa quais partes do seu site podem ser rastreadas<\/strong><\/p><\/li><li data-start=\"1310\" data-end=\"1378\"><p data-start=\"1312\" data-end=\"1378\">Impede que os rastreadores acessem <strong data-start=\"1354\" data-end=\"1378\">diret\u00f3rios ou p\u00e1ginas<\/strong> espec\u00edficos<\/p><\/li><li data-start=\"1379\" data-end=\"1437\"><p data-start=\"1381\" data-end=\"1437\">Ajuda a gerenciar o <strong data-start=\"1394\" data-end=\"1410\">or\u00e7amento de rastreamento<\/strong>, especialmente em sites grandes<\/p><\/li><li data-start=\"1438\" data-end=\"1520\"><p data-start=\"1440\" data-end=\"1520\">Reduz o rastreamento desnecess\u00e1rio que pode causar <strong data-start=\"1484\" data-end=\"1505\">conte\u00fado duplicado<\/strong> ou carga no servidor<\/p><\/li><\/ul><p data-start=\"1522\" data-end=\"1650\">O <strong data-start=\"1526\" data-end=\"1566\">arquivo robots.txt informa aos mecanismos de pesquisa<\/strong> o que eles podem ou n\u00e3o acessar, mas <strong data-start=\"1608\" data-end=\"1649\">n\u00e3o for\u00e7a a indexa\u00e7\u00e3o ou a desindexa\u00e7\u00e3o<\/strong>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-22f49dd9 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"22f49dd9\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-4049dd0a\" data-id=\"4049dd0a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7ecc3baa elementor-widget elementor-widget-heading\" data-id=\"7ecc3baa\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Por que seu site precisa de um arquivo robots.txt<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-1964306b elementor-widget elementor-widget-text-editor\" data-id=\"1964306b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"1702\" data-end=\"1851\">Todo site funciona com um <strong data-start=\"1726\" data-end=\"1742\">or\u00e7amento de rastreamento<\/strong>, o que significa que os mecanismos de pesquisa, como <strong data-start=\"1772\" data-end=\"1785\">o Googlebot<\/strong> e <strong data-start=\"1790\" data-end=\"1798\">o Bing<\/strong>, t\u00eam um <strong data-start=\"1806\" data-end=\"1821\">limite de rastreamento<\/strong> para o n\u00famero de URLs que visitam.<\/p><p data-start=\"1853\" data-end=\"1897\">O uso <strong data-start=\"1859\" data-end=\"1883\">correto<\/strong> do <strong data-start=\"1859\" data-end=\"1883\">robots.txt<\/strong> garante que voc\u00ea tenha acesso a ele:<\/p><ul data-start=\"1898\" data-end=\"2085\"><li data-start=\"1898\" data-end=\"1950\"><p data-start=\"1900\" data-end=\"1950\">Os mecanismos de pesquisa <strong data-start=\"1915\" data-end=\"1950\">rastreiam e indexam p\u00e1ginas importantes<\/strong><\/p><\/li><li data-start=\"1951\" data-end=\"1979\"><p data-start=\"1953\" data-end=\"1979\">URLs de baixo valor s\u00e3o ignorados<\/p><\/li><li data-start=\"1980\" data-end=\"2033\"><p data-start=\"1982\" data-end=\"2033\">URLs <strong data-start=\"1982\" data-end=\"2003\">de conte\u00fado duplicado<\/strong> n\u00e3o desperdi\u00e7am o or\u00e7amento de rastreamento<\/p><\/li><li data-start=\"2034\" data-end=\"2085\"><p data-start=\"2036\" data-end=\"2085\">Os recursos do servidor n\u00e3o s\u00e3o desperdi\u00e7ados por bots agressivos<\/p><\/li><\/ul><p data-start=\"2087\" data-end=\"2171\">Quando usado corretamente, o <strong data-start=\"2108\" data-end=\"2135\">robots.txt melhora o SEO<\/strong>, o desempenho e a efici\u00eancia do rastreamento.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-349232d3 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"349232d3\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-70d0e4f6\" data-id=\"70d0e4f6\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-531468e elementor-widget elementor-widget-heading\" data-id=\"531468e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">O que esse gerador gratuito de Robots.txt faz<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-475cabd4 elementor-widget elementor-widget-text-editor\" data-id=\"475cabd4\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"2223\" data-end=\"2272\">Nosso <strong data-start=\"2227\" data-end=\"2261\">gerador gratuito de arquivos robots.txt<\/strong> ajuda voc\u00ea:<\/p><ul data-start=\"2274\" data-end=\"2617\"><li data-start=\"2274\" data-end=\"2315\"><p data-start=\"2276\" data-end=\"2315\"><strong data-start=\"2276\" data-end=\"2315\">Gerar arquivos robots.txt instantaneamente<\/strong><\/p><\/li><li data-start=\"2316\" data-end=\"2377\"><p data-start=\"2318\" data-end=\"2377\">Criar <strong data-start=\"2325\" data-end=\"2341\">regras personalizadas<\/strong> usando <strong data-start=\"2356\" data-end=\"2377\">a sintaxe<\/strong> correta <strong data-start=\"2356\" data-end=\"2377\">do robots.txt<\/strong><\/p><\/li><li data-start=\"2378\" data-end=\"2417\"><p data-start=\"2380\" data-end=\"2417\">Adicionar <strong data-start=\"2384\" data-end=\"2417\">diretivas de permiss\u00e3o e n\u00e3o permiss\u00e3o<\/strong><\/p><\/li><li data-start=\"2418\" data-end=\"2486\"><p data-start=\"2420\" data-end=\"2486\">Controle o rastreamento para o <strong data-start=\"2441\" data-end=\"2486\">Googlebot, Bing e outros mecanismos de pesquisa<\/strong><\/p><\/li><li data-start=\"2487\" data-end=\"2531\"><p data-start=\"2489\" data-end=\"2531\">Bloqueie os bots de treinamento de IA sem prejudicar o SEO<\/p><\/li><li data-start=\"2532\" data-end=\"2568\"><p data-start=\"2534\" data-end=\"2568\">Otimizar <strong data-start=\"2543\" data-end=\"2568\">o rastreamento e a indexa\u00e7\u00e3o<\/strong><\/p><\/li><li data-start=\"2569\" data-end=\"2617\"><p data-start=\"2571\" data-end=\"2617\">Gerar regras com base nas <strong data-start=\"2600\" data-end=\"2617\">necessidades do<\/strong> seu <strong data-start=\"2600\" data-end=\"2617\">site<\/strong><\/p><\/li><\/ul><p data-start=\"2619\" data-end=\"2719\">Essa ferramenta foi criada por um <strong data-start=\"2643\" data-end=\"2657\">especialista em SEO<\/strong> com foco no <strong data-start=\"2669\" data-end=\"2701\">comportamento de rastreamento do mundo real<\/strong>, n\u00e3o apenas na teoria.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-35295016 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"35295016\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-1b9866ab\" data-id=\"1b9866ab\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-2ead07d9 elementor-widget elementor-widget-heading\" data-id=\"2ead07d9\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Como o robots.txt funciona (explica\u00e7\u00e3o r\u00e1pida)<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-3036d2d3 elementor-widget elementor-widget-text-editor\" data-id=\"3036d2d3\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"2771\" data-end=\"2798\">Um arquivo robots.txt cont\u00e9m:<\/p><ul data-start=\"2799\" data-end=\"2970\"><li data-start=\"2799\" data-end=\"2847\"><p data-start=\"2801\" data-end=\"2847\"><strong data-start=\"2801\" data-end=\"2815\">User-agent<\/strong> (a qual bot a regra se aplica)<\/p><\/li><li data-start=\"2848\" data-end=\"2915\"><p data-start=\"2850\" data-end=\"2915\"><strong data-start=\"2850\" data-end=\"2864\">Diretivas<\/strong> (regras como <code data-start=\"2877\" data-end=\"2884\">Allow<\/code>, <code data-start=\"2886\" data-end=\"2896\">Disallow<\/code>, ou <code data-start=\"2901\" data-end=\"2914\">Crawl-delay<\/code>)<\/p><\/li><li data-start=\"2916\" data-end=\"2970\"><p data-start=\"2918\" data-end=\"2970\">Refer\u00eancias opcionais, como o <strong data-start=\"2947\" data-end=\"2970\">URL do seu mapa do site<\/strong><\/p><\/li><\/ul><p data-start=\"2972\" data-end=\"2980\">Exemplo:<\/p><div class=\"contain-inline-size rounded-2xl corner-superellipse\/1.1 relative bg-token-sidebar-surface-primary\"><div class=\"@w-xl\/main:top-9 sticky top-[calc(--spacing(9)+var(--header-height))]\"><div class=\"absolute end-0 bottom-0 flex h-9 items-center pe-2\"><div class=\"bg-token-bg-elevated-secondary text-token-text-secondary flex items-center gap-4 rounded-sm px-2 font-sans text-xs\"> <\/div><\/div><\/div><div class=\"overflow-y-auto p-4\" dir=\"ltr\"><code class=\"whitespace-pre! language-txt\">User-agent: Googlebot\nAllow: \/\n\nUser-agent: *\nDisallow: \/wp-admin\/\n<\/code><\/div><\/div><p data-start=\"3060\" data-end=\"3176\">Cada <strong data-start=\"3065\" data-end=\"3078\">diretiva<\/strong> informa a um <strong data-start=\"3087\" data-end=\"3113\">mecanismo de pesquisa<\/strong> ou rastreador <strong data-start=\"3087\" data-end=\"3113\">espec\u00edfico<\/strong> como se comportar quando ele tentar <strong data-start=\"3156\" data-end=\"3175\">rastrear o seu site<\/strong>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-75221af3 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"75221af3\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-1f661613\" data-id=\"1f661613\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-4cd0c3f3 elementor-widget elementor-widget-heading\" data-id=\"4cd0c3f3\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Explica\u00e7\u00e3o das diretivas comuns do robots.txt<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-2544a7ff elementor-widget elementor-widget-text-editor\" data-id=\"2544a7ff\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<h3 data-start=\"3226\" data-end=\"3240\">Agente de usu\u00e1rio<\/h3><p data-start=\"3241\" data-end=\"3339\">Define a qual <strong data-start=\"3255\" data-end=\"3262\">bot<\/strong> a regra se aplica (por exemplo, <code data-start=\"3290\" data-end=\"3301\">Googlebot<\/code>, <code data-start=\"3303\" data-end=\"3312\">Bingbot<\/code>, ou <code data-start=\"3317\" data-end=\"3320\">*<\/code> para todos os rastreadores).<\/p><h3 data-start=\"3341\" data-end=\"3353\">N\u00e3o permitir<\/h3><p data-start=\"3354\" data-end=\"3460\">Use a <strong data-start=\"3362\" data-end=\"3384\">diretiva disallow<\/strong> para impedir que os rastreadores acessem um <strong data-start=\"3422\" data-end=\"3429\">URL<\/strong>, uma <strong data-start=\"3431\" data-end=\"3441\">pasta<\/strong> ou um <strong data-start=\"3446\" data-end=\"3459\">diret\u00f3rio<\/strong>.<\/p><h3 data-start=\"3462\" data-end=\"3471\">Permitir<\/h3><p data-start=\"3472\" data-end=\"3539\">Substitui uma regra de n\u00e3o permiss\u00e3o para URLs espec\u00edficos que voc\u00ea deseja que sejam indexados.<\/p><h3 data-start=\"3541\" data-end=\"3556\">Atraso de rastreamento<\/h3><p data-start=\"3557\" data-end=\"3638\">Controla a velocidade com que um rastreador deve solicitar p\u00e1ginas (\u00fatil para servidores sob carga).<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-14c7d353 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"14c7d353\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-56af137c\" data-id=\"56af137c\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-3dc7270 elementor-widget elementor-widget-heading\" data-id=\"3dc7270\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Onde fazer upload do arquivo robots.txt<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-51ea17c2 elementor-widget elementor-widget-text-editor\" data-id=\"51ea17c2\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"3685\" data-end=\"3728\">Depois de <strong data-start=\"3694\" data-end=\"3717\">gerar o robots.txt<\/strong>, voc\u00ea deve:<\/p><ol data-start=\"3730\" data-end=\"3930\"><li data-start=\"3730\" data-end=\"3777\"><p data-start=\"3733\" data-end=\"3777\">Salve-o como um <strong data-start=\"3746\" data-end=\"3758\">arquivo txt<\/strong> chamado  <code data-start=\"3765\" data-end=\"3777\">robots.txt<\/code><\/p><\/li><li data-start=\"3778\" data-end=\"3894\"><p data-start=\"3781\" data-end=\"3846\">Carregue o arquivo robots.txt na <strong data-start=\"3815\" data-end=\"3846\">pasta raiz do seu site<\/strong><\/p><div class=\"contain-inline-size rounded-2xl corner-superellipse\/1.1 relative bg-token-sidebar-surface-primary\"><div class=\"@w-xl\/main:top-9 sticky top-[calc(--spacing(9)+var(--header-height))]\"><div class=\"absolute end-0 bottom-0 flex h-9 items-center pe-2\"><div class=\"bg-token-bg-elevated-secondary text-token-text-secondary flex items-center gap-4 rounded-sm px-2 font-sans text-xs\"> <\/div><\/div><\/div><div class=\"overflow-y-auto p-4\" dir=\"ltr\"><code class=\"whitespace-pre!\">https:<span class=\"hljs-comment\">\/\/example.com\/robots.txt<\/span>\n<\/code><\/div><\/div><\/li><li data-start=\"3895\" data-end=\"3930\"><p data-start=\"3898\" data-end=\"3930\">Garantir que voc\u00ea tenha acesso p\u00fablico<\/p><\/li><\/ol><p data-start=\"3932\" data-end=\"3992\">Esse arquivo deve estar na <strong data-start=\"3959\" data-end=\"3967\">raiz<\/strong>, n\u00e3o em uma subpasta.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-4627379b elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"4627379b\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-66ad0721\" data-id=\"66ad0721\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-31db8715 elementor-widget elementor-widget-heading\" data-id=\"31db8715\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Envie seu arquivo robots.txt para o Google<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-18b44bd6 elementor-widget elementor-widget-text-editor\" data-id=\"18b44bd6\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"4041\" data-end=\"4096\">Depois de <strong data-start=\"4051\" data-end=\"4083\">atualizar o arquivo robots.txt<\/strong>, voc\u00ea deve:<\/p><ul data-start=\"4098\" data-end=\"4243\"><li data-start=\"4098\" data-end=\"4130\"><p data-start=\"4100\" data-end=\"4130\">Abra <strong data-start=\"4105\" data-end=\"4130\">o Console de pesquisa do Google<\/strong><\/p><\/li><li data-start=\"4131\" data-end=\"4162\"><p data-start=\"4133\" data-end=\"4162\">Use o <strong data-start=\"4141\" data-end=\"4162\">testador do robots.txt<\/strong><\/p><\/li><li data-start=\"4163\" data-end=\"4188\"><p data-start=\"4165\" data-end=\"4188\">Enviar ou testar o arquivo<\/p><\/li><li data-start=\"4189\" data-end=\"4243\"><p data-start=\"4191\" data-end=\"4243\">Verifique se <strong data-start=\"4203\" data-end=\"4220\">a pesquisa do Google<\/strong> pode rastrear URLs permitidos<\/p><\/li><\/ul><p data-start=\"4245\" data-end=\"4350\">Ao enviar o <strong data-start=\"4260\" data-end=\"4304\">arquivo robots.txt para o Google Search Console<\/strong>, voc\u00ea garante que o Google leia a vers\u00e3o mais recente.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-6f57f64 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"6f57f64\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-0871e50\" data-id=\"0871e50\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-39cf06b elementor-widget elementor-widget-heading\" data-id=\"39cf06b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">robots.txt vs. indexa\u00e7\u00e3o (importante)<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-48af0d8 elementor-widget elementor-widget-text-editor\" data-id=\"48af0d8\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"4396\" data-end=\"4413\">Usando o robots.txt:<\/p><ul data-start=\"4414\" data-end=\"4576\"><li data-start=\"4414\" data-end=\"4479\"><p data-start=\"4416\" data-end=\"4479\">N\u00c3O garante que uma p\u00e1gina ser\u00e1 removida dos resultados de pesquisa<\/p><\/li><li data-start=\"4480\" data-end=\"4519\"><p data-start=\"4482\" data-end=\"4519\">Controla o <strong data-start=\"4493\" data-end=\"4505\">rastreamento<\/strong>, n\u00e3o a indexa\u00e7\u00e3o<\/p><\/li><li data-start=\"4520\" data-end=\"4576\"><p data-start=\"4522\" data-end=\"4576\">Ajuda <strong data-start=\"4530\" data-end=\"4576\">os mecanismos de pesquisa a rastrear e indexar com efici\u00eancia<\/strong><\/p><\/li><\/ul><p data-start=\"4578\" data-end=\"4642\">Se uma p\u00e1gina <strong data-start=\"4595\" data-end=\"4627\">n\u00e3o<\/strong> deve <strong data-start=\"4595\" data-end=\"4627\">aparecer nos resultados de pesquisa<\/strong>, voc\u00ea pode precisar:<\/p><ul data-start=\"4643\" data-end=\"4726\"><li data-start=\"4643\" data-end=\"4664\"><p data-start=\"4645\" data-end=\"4664\"><code data-start=\"4645\" data-end=\"4654\">noindex<\/code>  meta tags<\/p><\/li><li data-start=\"4665\" data-end=\"4688\"><p data-start=\"4667\" data-end=\"4688\">URLs can\u00f4nicos adequados<\/p><\/li><li data-start=\"4689\" data-end=\"4726\"><p data-start=\"4691\" data-end=\"4726\">Ferramentas de remo\u00e7\u00e3o no <strong data-start=\"4708\" data-end=\"4726\">Search Console<\/strong><\/p><\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-097ec62 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"097ec62\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-0994d33\" data-id=\"0994d33\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-b878e97 elementor-widget elementor-widget-heading\" data-id=\"b878e97\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">robots.txt e conte\u00fado duplicado<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-0dddd26 elementor-widget elementor-widget-text-editor\" data-id=\"0dddd26\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"4770\" data-end=\"4815\">Um arquivo robots.txt configurado corretamente ajuda:<\/p><ul data-start=\"4816\" data-end=\"4950\"><li data-start=\"4816\" data-end=\"4852\"><p data-start=\"4818\" data-end=\"4852\">Impedir o rastreamento de par\u00e2metros de URL<\/p><\/li><li data-start=\"4853\" data-end=\"4896\"><p data-start=\"4855\" data-end=\"4896\">Reduzir o rastreamento de URLs de pesquisa e filtro<\/p><\/li><li data-start=\"4897\" data-end=\"4950\"><p data-start=\"4899\" data-end=\"4950\">Evite desperdi\u00e7ar o or\u00e7amento de rastreamento com <strong data-start=\"4929\" data-end=\"4950\">conte\u00fado duplicado<\/strong><\/p><\/li><\/ul><p data-start=\"4952\" data-end=\"5021\">Isso \u00e9 especialmente importante para sites grandes e lojas de com\u00e9rcio eletr\u00f4nico.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-55800a3 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"55800a3\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-4216443\" data-id=\"4216443\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-e064f7e elementor-widget elementor-widget-heading\" data-id=\"e064f7e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Rastreadores de IA, bots e carga de servidor<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-473f43b elementor-widget elementor-widget-text-editor\" data-id=\"473f43b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"5067\" data-end=\"5135\">Os sites modernos s\u00e3o rastreados n\u00e3o apenas pelos mecanismos de pesquisa, mas tamb\u00e9m por voc\u00ea:<\/p><ul data-start=\"5136\" data-end=\"5187\"><li data-start=\"5136\" data-end=\"5154\"><p data-start=\"5138\" data-end=\"5154\">Bots de treinamento de IA<\/p><\/li><li data-start=\"5155\" data-end=\"5165\"><p data-start=\"5157\" data-end=\"5165\">Raspadores<\/p><\/li><li data-start=\"5166\" data-end=\"5187\"><p data-start=\"5168\" data-end=\"5187\">Rastreadores agressivos<\/p><\/li><\/ul><p data-start=\"5189\" data-end=\"5347\">Esse <strong data-start=\"5194\" data-end=\"5218\">gerador de robots.txt<\/strong> ajuda a bloquear os rastreadores de IA e, ao mesmo tempo, garante que <strong data-start=\"5263\" data-end=\"5298\">o Google e outros mecanismos de pesquisa<\/strong> ainda possam rastrear e indexar seu conte\u00fado adequadamente.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-0d261dc elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"0d261dc\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-1794b11\" data-id=\"1794b11\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-adc3f76 elementor-widget elementor-widget-heading\" data-id=\"adc3f76\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Quando voc\u00ea deve usar o robots.txt<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-7e526b8 elementor-widget elementor-widget-text-editor\" data-id=\"7e526b8\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"5389\" data-end=\"5407\">Use o robots.txt se voc\u00ea:<\/p><ul data-start=\"5408\" data-end=\"5643\"><li data-start=\"5408\" data-end=\"5450\"><p data-start=\"5410\" data-end=\"5450\">Partes do seu site n\u00e3o devem ser rastreadas<\/p><\/li><li data-start=\"5451\" data-end=\"5489\"><p data-start=\"5453\" data-end=\"5489\">Seu site funciona com um <strong data-start=\"5473\" data-end=\"5489\">or\u00e7amento de rastreamento<\/strong><\/p><\/li><li data-start=\"5490\" data-end=\"5549\"><p data-start=\"5492\" data-end=\"5549\">Voc\u00ea deseja controlar como <strong data-start=\"5516\" data-end=\"5542\">os rastreadores dos mecanismos de pesquisa<\/strong> se comportam<\/p><\/li><li data-start=\"5550\" data-end=\"5596\"><p data-start=\"5552\" data-end=\"5596\">Certas p\u00e1ginas n\u00e3o devem ser acessadas por bots<\/p><\/li><li data-start=\"5597\" data-end=\"5643\"><p data-start=\"5599\" data-end=\"5643\">Voc\u00ea deseja melhorar a efici\u00eancia do rastreamento e o SEO<\/p><\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-0c4940e elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"0c4940e\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-930092a\" data-id=\"930092a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-83550c3 elementor-widget elementor-widget-heading\" data-id=\"83550c3\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Gere seu arquivo robots.txt agora<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-b701be9 elementor-widget elementor-widget-text-editor\" data-id=\"b701be9\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"5688\" data-end=\"5735\">Use nosso <strong data-start=\"5696\" data-end=\"5725\">gerador de robots.txt gratuito<\/strong> acima para voc\u00ea:<\/p><ul data-start=\"5737\" data-end=\"5920\"><li data-start=\"5737\" data-end=\"5767\"><p data-start=\"5739\" data-end=\"5767\"><strong data-start=\"5739\" data-end=\"5767\">Crie um arquivo robots.txt<\/strong><\/p><\/li><li data-start=\"5768\" data-end=\"5803\"><p data-start=\"5770\" data-end=\"5803\">Gerar regras com base em seu site<\/p><\/li><li data-start=\"5804\" data-end=\"5837\"><p data-start=\"5806\" data-end=\"5837\">Teste seu arquivo antes da implementa\u00e7\u00e3o<\/p><\/li><li data-start=\"5838\" data-end=\"5869\"><p data-start=\"5840\" data-end=\"5869\">Melhorar a rastreabilidade e a indexa\u00e7\u00e3o<\/p><\/li><li data-start=\"5870\" data-end=\"5920\"><p data-start=\"5872\" data-end=\"5920\">Garantir que o Google e o Bing rastreiem os URLs corretos<\/p><\/li><\/ul><p data-start=\"5922\" data-end=\"6004\">Essa ferramenta ajuda voc\u00ea <strong data-start=\"5942\" data-end=\"5981\">a gerar arquivos robots.txt eficazes<\/strong>, de forma segura e instant\u00e2nea.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-e7ce08d elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"e7ce08d\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-64dc156a\" data-id=\"64dc156a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-45ea0e2a elementor-widget elementor-widget-heading\" data-id=\"45ea0e2a\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">FAQs<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-2591eca elementor-widget elementor-widget-html\" data-id=\"2591eca\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<script type=\"application\/ld+json\">{\r\n  \"@context\": \"https:\/\/schema.org\",\r\n  \"@type\": \"FAQPage\",\r\n  \"mainEntity\": [\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"What is a robots.txt file?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"A robots.txt file is a text file placed in the root folder of your website that tells search engine crawlers which parts of your site they are allowed or not allowed to crawl, based on the robots exclusion protocol.\"\r\n      }\r\n    },\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"Does robots.txt affect SEO?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"Yes. robots.txt affects SEO by controlling crawling behavior, crawl budget usage, and which URLs search engines can access. It does not directly control indexing but helps search engines crawl your website efficiently.\"\r\n      }\r\n    },\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"Can robots.txt block Google from indexing my website?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"robots.txt can prevent Googlebot from crawling URLs, but it does not guarantee removal from search results. To control indexing, use noindex meta tags or Google Search Console removal tools.\"\r\n      }\r\n    },\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"Where should I upload the robots.txt file?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"The robots.txt file must be uploaded to the root folder of your website, for example: https:\/\/example.com\/robots.txt. Search engines will only check this location.\"\r\n      }\r\n    },\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"Should I block AI crawlers using robots.txt?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"Blocking AI crawlers using robots.txt can reduce unnecessary crawling and server load. However, enforcement is stronger when combined with Cloudflare WAF or bot protection settings.\"\r\n      }\r\n    },\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"How do I test my robots.txt file?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"You can test your robots.txt file using the robots.txt tester inside Google Search Console to verify that Googlebot can crawl important URLs and that disallowed rules are working correctly.\"\r\n      }\r\n    }\r\n  ]\r\n}\r\n<\/script>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-293be7ee elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"293be7ee\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-43950af2\" data-id=\"43950af2\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-1d21b482 elementor-widget elementor-widget-heading\" data-id=\"1d21b482\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Conclus\u00e3o<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-5b0fee02 elementor-widget elementor-widget-text-editor\" data-id=\"5b0fee02\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul data-start=\"6031\" data-end=\"6268\"><li data-start=\"6031\" data-end=\"6078\"><p data-start=\"6033\" data-end=\"6078\">O robots.txt \u00e9 um arquivo que <strong data-start=\"6059\" data-end=\"6078\">orienta os rastreadores<\/strong><\/p><\/li><li data-start=\"6079\" data-end=\"6125\"><p data-start=\"6081\" data-end=\"6125\">Ele deve seguir <strong data-start=\"6104\" data-end=\"6125\">a sintaxe<\/strong> correta <strong data-start=\"6104\" data-end=\"6125\">do robots.txt<\/strong><\/p><\/li><li data-start=\"6126\" data-end=\"6176\"><p data-start=\"6128\" data-end=\"6176\">Sempre teste as altera\u00e7\u00f5es no <strong data-start=\"6151\" data-end=\"6176\">Google Search Console<\/strong><\/p><\/li><li data-start=\"6177\" data-end=\"6268\"><p data-start=\"6179\" data-end=\"6268\">Um robots.txt bem configurado garante que <strong data-start=\"6221\" data-end=\"6268\">os mecanismos de pesquisa rastreiem e indexem o que \u00e9 importante<\/strong><\/p><\/li><\/ul><p data-start=\"6270\" data-end=\"6435\">Se voc\u00ea deseja ser indexado, controlar o comportamento de rastreamento e proteger seu servidor, <strong data-start=\"6347\" data-end=\"6384\">use nosso gerador gratuito de robots.txt<\/strong> para criar um arquivo robots.txt limpo e seguro para SEO hoje mesmo.<\/p><p data-start=\"193\" data-end=\"611\">Saber como <strong data-start=\"208\" data-end=\"229\">criar<\/strong> corretamente o arquivo <strong data-start=\"208\" data-end=\"229\">robots.txt<\/strong> \u00e9 uma etapa essencial para qualquer site que queira controlar o rastreamento e <strong data-start=\"312\" data-end=\"332\">aprimorar seu SEO<\/strong>. Ao <strong data-start=\"343\" data-end=\"371\">criar um arquivo robots.txt<\/strong>, voc\u00ea est\u00e1 definindo um <strong data-start=\"392\" data-end=\"414\">arquivo que cont\u00e9m<\/strong> instru\u00e7\u00f5es claras para os rastreadores de mecanismos de pesquisa <strong data-start=\"461\" data-end=\"476\">como o Google<\/strong>, ajudando-os a entender quais <strong data-start=\"508\" data-end=\"533\">p\u00e1ginas do seu site<\/strong> devem ser rastreadas e qual <strong data-start=\"562\" data-end=\"593\">parte do site precisa<\/strong> ser restrita. <\/p><p data-start=\"613\" data-end=\"960\">Ao <strong data-start=\"616\" data-end=\"650\">gerar o arquivo robots.txt<\/strong>, voc\u00ea pode criar facilmente um <strong data-start=\"675\" data-end=\"694\">arquivo que lista<\/strong> regras para bots, gerenciar o rastreamento <strong data-start=\"727\" data-end=\"753\">com base em um limite de rastreamento<\/strong> e evitar o desperd\u00edcio de or\u00e7amento de rastreamento em URLs desnecess\u00e1rios. Ao adicionar regras, lembre-se de <strong data-start=\"838\" data-end=\"863\">adicionar a barra<\/strong> e especificar o <strong data-start=\"886\" data-end=\"914\">endere\u00e7o<\/strong> exato <strong data-start=\"886\" data-end=\"914\">do diret\u00f3rio<\/strong> que voc\u00ea deseja permitir ou bloquear para evitar erros. <\/p><p data-start=\"962\" data-end=\"1254\">Depois que suas regras forem finalizadas, sempre <strong data-start=\"1000\" data-end=\"1028\">envie um arquivo robots.txt<\/strong> para os mecanismos de pesquisa e verifique-o usando ferramentas de teste para garantir o comportamento adequado. Um arquivo robots.txt bem estruturado oferece a voc\u00ea melhor controle de rastreamento, indexa\u00e7\u00e3o mais limpa e uma base t\u00e9cnica mais s\u00f3lida para o sucesso de SEO a longo prazo. <\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/main>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Escrito por Use nosso gerador gratuito de robots.txt para criar instantaneamente um arquivo robots.txt que ajude o Google e outros mecanismos de pesquisa a rastrear e indexar seu site corretamente, sem desperdi\u00e7ar o or\u00e7amento de rastreamento ou expor partes sens\u00edveis do seu site. Essa ferramenta f\u00e1cil de usar gera arquivos robots.txt eficazes para o seu [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":400588,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"elementor_header_footer","meta":{"_acf_changed":false,"footnotes":""},"class_list":["post-401926","page","type-page","status-publish","has-post-thumbnail","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/barrazacarlos.com\/pt-br\/wp-json\/wp\/v2\/pages\/401926","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/barrazacarlos.com\/pt-br\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/barrazacarlos.com\/pt-br\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/barrazacarlos.com\/pt-br\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/barrazacarlos.com\/pt-br\/wp-json\/wp\/v2\/comments?post=401926"}],"version-history":[{"count":0,"href":"https:\/\/barrazacarlos.com\/pt-br\/wp-json\/wp\/v2\/pages\/401926\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/barrazacarlos.com\/pt-br\/wp-json\/wp\/v2\/media\/400588"}],"wp:attachment":[{"href":"https:\/\/barrazacarlos.com\/pt-br\/wp-json\/wp\/v2\/media?parent=401926"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}