{"id":401908,"date":"2025-12-30T11:10:50","date_gmt":"2025-12-30T18:10:50","guid":{"rendered":"https:\/\/barrazacarlos.com\/free-robots-txt-generator\/"},"modified":"2025-12-30T11:11:06","modified_gmt":"2025-12-30T18:11:06","slug":"free-robots-txt-generator","status":"publish","type":"page","link":"https:\/\/barrazacarlos.com\/tr\/free-robots-txt-generator\/","title":{"rendered":"\u00dccretsiz Robots.txt Olu\u015fturucu (SEO-G\u00fcvenli + AI Crawler Kontrol\u00fc)"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-page\" data-elementor-id=\"401908\" class=\"elementor elementor-401908 elementor-400576\" data-elementor-post-type=\"page\">\n\t\t\t\t\t\t<main class=\"elementor-section elementor-top-section elementor-element elementor-element-23bfe264 elementor-section-height-min-height elementor-section-content-bottom elementor-section-boxed elementor-section-height-default elementor-section-items-middle\" data-id=\"23bfe264\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t\t<div class=\"elementor-background-overlay\"><\/div>\n\t\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-wider\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-619cb1bc\" data-id=\"619cb1bc\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-564894ed elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"564894ed\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-23e29665\" data-id=\"23e29665\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-1f79b8e3 elementor-widget elementor-widget-heading\" data-id=\"1f79b8e3\" data-element_type=\"widget\" data-e-type=\"widget\" data-settings=\"{&quot;_animation&quot;:&quot;none&quot;,&quot;_animation_delay&quot;:&quot;800&quot;}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h1 class=\"elementor-heading-title elementor-size-default\">\u00dccretsiz Robots.txt Olu\u015fturucu (SEO-G\u00fcvenli + AI Crawler Kontrol\u00fc)<\/h1>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-70a5da2c elementor-widget elementor-widget-heading\" data-id=\"70a5da2c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<span class=\"elementor-heading-title elementor-size-default\">Taraf\u0131ndan yaz\u0131ld\u0131<\/span>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-642f6018 elementor-align-left elementor-widget elementor-widget-post-info\" data-id=\"642f6018\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"post-info.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ul class=\"elementor-inline-items elementor-icon-list-items elementor-post-info\">\n\t\t\t\t\t\t\t\t<li class=\"elementor-icon-list-item elementor-repeater-item-ef43aea elementor-inline-item\" itemprop=\"author\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text elementor-post-info__item elementor-post-info__item--type-author\">\n\t\t\t\t\t\t\t\t\t\tRedaction Team\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t<li class=\"elementor-icon-list-item elementor-repeater-item-476dca5 elementor-inline-item\" itemprop=\"datePublished\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<span class=\"elementor-icon-list-text elementor-post-info__item elementor-post-info__item--type-date\">\n\t\t\t\t\t\t\t\t\t\t<time>Aral\u0131k 30, 2025<\/time>\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t<\/ul>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5c576898 elementor-widget elementor-widget-text-editor\" data-id=\"5c576898\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"371\" data-end=\"608\">Tarama b\u00fct\u00e7esini <strong data-start=\"462\" data-end=\"536\">bo\u015fa harcamadan<\/strong> veya sitenizin hassas k\u0131s\u0131mlar\u0131n\u0131 a\u00e7\u0131\u011fa \u00e7\u0131karmadan <strong data-start=\"462\" data-end=\"536\">,<\/strong> <strong data-start=\"412\" data-end=\"450\">Google<\/strong> ve di\u011fer <strong data-start=\"462\" data-end=\"536\">arama motorlar\u0131n\u0131n web sitenizi do\u011fru bir \u015fekilde taramas\u0131na ve dizine eklemesine<\/strong> <strong data-start=\"412\" data-end=\"450\">yard\u0131mc\u0131 olan bir robots.txt dosyas\u0131n\u0131 an\u0131nda<\/strong> <strong data-start=\"379\" data-end=\"408\">olu\u015fturmak i\u00e7in \u00fccretsiz robots.txt olu\u015fturucumuzu<\/strong> kullan\u0131n.<\/p><p data-start=\"610\" data-end=\"825\">Bu <strong data-start=\"615\" data-end=\"635\">kullan\u0131m\u0131 kolay ara\u00e7<\/strong> <strong data-start=\"646\" data-end=\"693\">,<\/strong> robots <strong data-start=\"709\" data-end=\"794\">d\u0131\u015flama protokol\u00fcn\u00fc (robots d\u0131\u015flama protokol\u00fc veya standard\u0131 olarak da adland\u0131r\u0131l\u0131r) ve modern SEO en iyi uygulamalar\u0131n\u0131<\/strong> <strong data-start=\"646\" data-end=\"693\">izleyerek web siteniz i\u00e7in etkili robots.txt dosyalar\u0131<\/strong> <strong data-start=\"615\" data-end=\"635\">olu\u015fturur<\/strong> <strong data-start=\"646\" data-end=\"693\">.<\/strong><\/p><p data-start=\"827\" data-end=\"993\"><strong data-start=\"847\" data-end=\"938\">Taray\u0131c\u0131lar\u0131n belirli URL&#8217;lere, klas\u00f6rlere, dizinlere veya sayfalara eri\u015fmesine izin vermek veya vermemek<\/strong> istiyorsan\u0131z <strong data-start=\"847\" data-end=\"938\">, bu robots<\/strong> txt <strong data-start=\"945\" data-end=\"969\">olu\u015fturucu bunu g\u00fcvenli bir \u015fekilde yapman\u0131za yard\u0131mc\u0131 olur<\/strong> <strong data-start=\"847\" data-end=\"938\">.<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<div class=\"elementor-column elementor-col-50 elementor-inner-column elementor-element elementor-element-761c4a6c\" data-id=\"761c4a6c\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-2adebe2e elementor-widget elementor-widget-image\" data-id=\"2adebe2e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"1280\" height=\"720\" src=\"https:\/\/barrazacarlos.com\/wp-content\/uploads\/2025\/12\/Free-Robots.txt-Generator.webp\" class=\"attachment-full size-full wp-image-400593\" alt=\"Free Robots.txt Generator\" srcset=\"https:\/\/barrazacarlos.com\/wp-content\/uploads\/2025\/12\/Free-Robots.txt-Generator.webp 1280w, https:\/\/barrazacarlos.com\/wp-content\/uploads\/2025\/12\/Free-Robots.txt-Generator-300x169.webp 300w, https:\/\/barrazacarlos.com\/wp-content\/uploads\/2025\/12\/Free-Robots.txt-Generator-1024x576.webp 1024w, https:\/\/barrazacarlos.com\/wp-content\/uploads\/2025\/12\/Free-Robots.txt-Generator-768x432.webp 768w\" sizes=\"(max-width: 1280px) 100vw, 1280px\" title=\"\">\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-84b5082 elementor-toc--minimized-on-desktop elementor-widget elementor-widget-table-of-contents\" data-id=\"84b5082\" data-element_type=\"widget\" data-e-type=\"widget\" data-settings=\"{&quot;headings_by_tags&quot;:[&quot;h2&quot;],&quot;exclude_headings_by_selector&quot;:[],&quot;collapse_subitems&quot;:&quot;yes&quot;,&quot;no_headings_message&quot;:&quot;No headings were found on this page.&quot;,&quot;minimized_on&quot;:&quot;desktop&quot;,&quot;marker_view&quot;:&quot;numbers&quot;,&quot;minimize_box&quot;:&quot;yes&quot;,&quot;hierarchical_view&quot;:&quot;yes&quot;,&quot;min_height&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]},&quot;min_height_tablet&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]},&quot;min_height_mobile&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"table-of-contents.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-toc__header\">\n\t\t\t\t\t\t<div class=\"elementor-toc__header-title\">\n\t\t\t\t\u0130\u00e7indekiler\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t<div class=\"elementor-toc__toggle-button elementor-toc__toggle-button--expand\" role=\"button\" tabindex=\"0\" aria-controls=\"elementor-toc__84b5082\" aria-expanded=\"true\" aria-label=\"Open table of contents\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 448 512\"><path d=\"M207.029 381.476L12.686 187.132c-9.373-9.373-9.373-24.569 0-33.941l22.667-22.667c9.357-9.357 24.522-9.375 33.901-.04L224 284.505l154.745-154.021c9.379-9.335 24.544-9.317 33.901.04l22.667 22.667c9.373 9.373 9.373 24.569 0 33.941L240.971 381.476c-9.373 9.372-24.569 9.372-33.942 0z\"><\/path><\/svg><\/div>\n\t\t\t\t<div class=\"elementor-toc__toggle-button elementor-toc__toggle-button--collapse\" role=\"button\" tabindex=\"0\" aria-controls=\"elementor-toc__84b5082\" aria-expanded=\"true\" aria-label=\"Close table of contents\"><svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 448 512\"><path d=\"M240.971 130.524l194.343 194.343c9.373 9.373 9.373 24.569 0 33.941l-22.667 22.667c-9.357 9.357-24.522 9.375-33.901.04L224 227.495 69.255 381.516c-9.379 9.335-24.544 9.317-33.901-.04l-22.667-22.667c-9.373-9.373-9.373-24.569 0-33.941L207.03 130.525c9.372-9.373 24.568-9.373 33.941-.001z\"><\/path><\/svg><\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<div id=\"elementor-toc__84b5082\" class=\"elementor-toc__body elementor-toc__list-items--collapsible\">\n\t\t\t<div class=\"elementor-toc__spinner-container\">\n\t\t\t\t<svg class=\"elementor-toc__spinner eicon-animation-spin e-font-icon-svg e-eicon-loading\" aria-hidden=\"true\" viewBox=\"0 0 1000 1000\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\"><path d=\"M500 975V858C696 858 858 696 858 500S696 142 500 142 142 304 142 500H25C25 237 238 25 500 25S975 237 975 500 763 975 500 975Z\"><\/path><\/svg>\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-1574994 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"1574994\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-89c087c\" data-id=\"89c087c\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-2848f36 elementor-widget elementor-widget-heading\" data-id=\"2848f36\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">\u00dccretsiz robots.txt Dosya olu\u015fturucu<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-cd4ce4f elementor-widget elementor-widget-html\" data-id=\"cd4ce4f\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div id=\"robots-generator\" style=\"max-width:950px;font-family:system-ui,sans-serif\">\r\n\r\n  <!-- DIRECTORIES -->\r\n  <h3>Hassas Dizinleri Engelle<\/h3>\r\n  <label><input type=\"checkbox\" value=\"\/wp-admin\/\">  \/wp-admin\/ (Y\u00fcksek CPU etkisi)<\/label><br>  <label><input type=\"checkbox\" value=\"\/wp-includes\/\">  \/wp-includes\/ (Orta CPU etkisi)<\/label><br>  <label><input type=\"checkbox\" value=\"\/cgi-bin\/\">  \/cgi-bin\/ (D\u00fc\u015f\u00fck CPU etkisi)<\/label><br><br>\r\n  <label>\r\n    <input type=\"checkbox\" id=\"allowAjax\">\r\n  \u0130zin ver \/wp-admin\/admin-ajax.php\r\n  <\/label><br><br>\r\n  <!-- SEARCH CRAWLERS -->\r\n  <h3>Arama Motoru Taray\u0131c\u0131lar\u0131 (Varsay\u0131lan: \u0130zin Ver)<\/h3>\r\n  <small>Engellemek i\u00e7in bir taray\u0131c\u0131 se\u00e7in<\/small><br><br>\r\n  <div style=\"columns:2\">\r\n    <label><input type=\"checkbox\" data-agent=\"Googlebot\">  Google<\/label><br>    <label><input type=\"checkbox\" data-agent=\"bingbot\">  Bing<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Slurp\">  Yahoo<\/label><br>    <label><input type=\"checkbox\" data-agent=\"DuckDuckBot\">  DuckDuckGo<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Baiduspider\">  Baidu<\/label><br>    <label><input type=\"checkbox\" data-agent=\"YandexBot\">  Yandex<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Applebot\">  Elma<\/label><br>    <label><input type=\"checkbox\" data-agent=\"NaverBot\">  Naver<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Teoma\">  Sor \/ Teoma<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Gigabot\">  GigaBlast<\/label><br>    <label><input type=\"checkbox\" data-agent=\"msnbot\">  MSN Arama<\/label><br>    <label><input type=\"checkbox\" data-agent=\"msnbot-media\">  MSN PicSearch<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Googlebot-Image\">  Google G\u00f6rseller<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Googlebot-Mobile\">  Google Mobile<\/label><br>  <\/div>\r\n\r\n  <!-- OTHER KNOWN CRAWLERS -->\r\n  <h3>SEO ve Yard\u0131mc\u0131 Taray\u0131c\u0131lar (Varsay\u0131lan: \u0130zin Ver)<\/h3>\r\n  <div style=\"columns:2\">\r\n    <label><input type=\"checkbox\" data-agent=\"AhrefsBot\">  Ahrefs<\/label><br>    <label><input type=\"checkbox\" data-agent=\"SemrushBot\">  Semrush<\/label><br>    <label><input type=\"checkbox\" data-agent=\"MJ12bot\">  Majestic<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Mozbot\">  Moz<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Screaming Frog SEO Spider\">  \u00c7\u0131\u011fl\u0131k Atan Kurba\u011fa<\/label><br>    <label><input type=\"checkbox\" data-agent=\"CCBot\">  Ortak S\u00fcr\u00fcnme<\/label><br>    <label><input type=\"checkbox\" data-agent=\"ia_archiver\">  Alexa \/ Wayback<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Pinterestbot\">  Pinterest<\/label><br>    <label><input type=\"checkbox\" data-agent=\"facebookexternalhit\">  Facebook<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Twitterbot\">  Twitter<\/label><br>  <\/div>\r\n\r\n  <!-- AI CRAWLERS -->\r\n  <h3>Yapay Zeka Taray\u0131c\u0131lar\u0131 ve LLM E\u011fitim Botlar\u0131 (Varsay\u0131lan: \u0130zin Ver)<\/h3>\r\n  <small>Bunlar\u0131n engellenmesi sunucu y\u00fck\u00fcn\u00fc ve veri kullan\u0131m\u0131n\u0131 azaltabilir<\/small><br><br>\r\n  <div style=\"columns:2\">\r\n    <label><input type=\"checkbox\" data-agent=\"GPTBot\">  OpenAI (GPTBot) - Y\u00fcksek CPU etkisi<\/label><br>    <label><input type=\"checkbox\" data-agent=\"ChatGPT-User\">  ChatGPT Kullan\u0131c\u0131s\u0131<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Google-Extended\">  Google AI (SGE \/ Gemini)<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Meta-ExternalAgent\">  Meta Yapay Zeka<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Applebot-Extended\">  Apple Yapay Zeka<\/label><br>    <label><input type=\"checkbox\" data-agent=\"PerplexityBot\">  Perplexity Yapay Zeka<\/label><br>    <label><input type=\"checkbox\" data-agent=\"ClaudeBot\">  Antropik \/ Claude<\/label><br>    <label><input type=\"checkbox\" data-agent=\"Bytespider\">  TikTok \/ ByteDance AI<\/label><br>  <\/div>\r\n\r\n  <!-- OPTIONS -->\r\n  <h3>\u0130ste\u011fe Ba\u011fl\u0131 Ayarlar<\/h3>\r\n  <label>Tarama gecikmesi (saniye)<\/label><br>  <input type=\"number\" id=\"crawlDelay\" min=\"0\"><br><br>\r\n  <label>Site Haritas\u0131 URL'si<\/label><br>  <input type=\"url\" id=\"sitemapUrl\" placeholder=\"https:\/\/example.com\/sitemap.xml\" style=\"width:100%\"><br><br>\r\n  <button onclick=\"generateRobots()\" style=\"padding:10px 20px;font-weight:bold\">\r\n  Robots.txt olu\u015fturun\r\n  <\/button>\r\n\r\n  <button onclick=\"downloadRobots()\" style=\"padding:10px 20px;font-weight:bold;margin-left:10px\">\r\n  Robots.txt dosyas\u0131n\u0131 indirin\r\n  <\/button>\r\n\r\n  <h3>Olu\u015fturulan robots.txt<\/h3>\r\n  <textarea id=\"output\" rows=\"20\" style=\"width:100%;font-family:monospace\"><\/textarea>\r\n<\/div>\r\n\r\n<script>\r\nfunction generateRobots() {\r\n  let output = [];\r\n  output.push(\"User-agent: *\");\r\n\r\n  document.querySelectorAll('#robots-generator input[type=\"checkbox\"]:checked').forEach(cb => {\r\n    if (cb.value && !cb.dataset.agent && cb.id !== \"allowAjax\") {\r\n      output.push(\"Disallow: \" + cb.value);\r\n    }\r\n  });\r\n\r\n  if (document.getElementById(\"allowAjax\").checked) {\r\n    output.push(\"Allow: \/wp-admin\/admin-ajax.php\");\r\n  }\r\n\r\n  let delay = document.getElementById(\"crawlDelay\").value;\r\n  if (delay) {\r\n    output.push(\"Crawl-delay: \" + delay);\r\n  }\r\n\r\n  document.querySelectorAll('#robots-generator input[data-agent]:checked').forEach(cb => {\r\n    output.push(\"\");\r\n    output.push(\"User-agent: \" + cb.dataset.agent);\r\n    output.push(\"Disallow: \/\");\r\n  });\r\n\r\n  let sitemap = document.getElementById(\"sitemapUrl\").value;\r\n  if (sitemap) {\r\n    output.push(\"\");\r\n    output.push(\"Sitemap: \" + sitemap);\r\n  }\r\n\r\n  document.getElementById(\"output\").value = output.join(\"\\n\");\r\n}\r\n\r\nfunction downloadRobots() {\r\n  const content = document.getElementById(\"output\").value;\r\n  if (!content) {\r\n    alert(\"Please generate the robots.txt file first.\");\r\n    return;\r\n  }\r\n\r\n  const blob = new Blob([content], { type: \"text\/plain\" });\r\n  const url = URL.createObjectURL(blob);\r\n\r\n  const a = document.createElement(\"a\");\r\n  a.href = url;\r\n  a.download = \"robots.txt\";\r\n  document.body.appendChild(a);\r\n  a.click();\r\n\r\n  document.body.removeChild(a);\r\n  URL.revokeObjectURL(url);\r\n}\r\n<\/script>\r\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-1cc93a8b elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"1cc93a8b\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-10e15af5\" data-id=\"10e15af5\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-42f573c1 elementor-widget elementor-widget-heading\" data-id=\"42f573c1\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Robots.txt Dosyas\u0131 Nedir?<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-362f6567 elementor-widget elementor-widget-text-editor\" data-id=\"362f6567\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"1031\" data-end=\"1191\"><strong data-start=\"1033\" data-end=\"1052\">Robots.txt dosyas\u0131,<\/strong> <strong data-start=\"1086\" data-end=\"1117\">web sitenizin<\/strong> k\u00f6k <strong data-start=\"1086\" data-end=\"1117\">klas\u00f6r\u00fcne<\/strong> <strong data-start=\"1058\" data-end=\"1071\">yerle\u015ftirilen<\/strong> <strong data-start=\"1086\" data-end=\"1117\">ve<\/strong> bir arama <strong data-start=\"1131\" data-end=\"1156\">motoru taray\u0131c\u0131s\u0131na<\/strong> <strong data-start=\"1168\" data-end=\"1190\">web sitenizi<\/strong> <strong data-start=\"1131\" data-end=\"1156\">nas\u0131l tarayabilece\u011fini<\/strong> <strong data-start=\"1086\" data-end=\"1117\">s\u00f6yleyen<\/strong> <strong data-start=\"1033\" data-end=\"1052\">bir metin dosyas\u0131d\u0131r<\/strong> <strong data-start=\"1168\" data-end=\"1190\">.<\/strong><\/p><p data-start=\"1193\" data-end=\"1228\">Basit bir ifadeyle, bir <strong data-start=\"1212\" data-end=\"1227\">robot dosyas\u0131:<\/strong><\/p><ul data-start=\"1229\" data-end=\"1520\"><li data-start=\"1229\" data-end=\"1309\"><p data-start=\"1231\" data-end=\"1309\"><strong data-start=\"1237\" data-end=\"1309\">Arama motorlar\u0131na web sitenizin hangi b\u00f6l\u00fcmlerini taramalar\u0131na izin verildi\u011fini<\/strong> s\u00f6yler<\/p><\/li><li data-start=\"1310\" data-end=\"1378\"><p data-start=\"1312\" data-end=\"1378\">Taray\u0131c\u0131lar\u0131n belirli <strong data-start=\"1354\" data-end=\"1378\">dizinlere veya sayfalara<\/strong> eri\u015fmesini engeller<\/p><\/li><li data-start=\"1379\" data-end=\"1437\"><p data-start=\"1381\" data-end=\"1437\">\u00d6zellikle b\u00fcy\u00fck sitelerde <strong data-start=\"1394\" data-end=\"1410\">tarama b\u00fct\u00e7esini<\/strong> y\u00f6netmeye yard\u0131mc\u0131 olur<\/p><\/li><li data-start=\"1438\" data-end=\"1520\"><p data-start=\"1440\" data-end=\"1520\"><strong data-start=\"1484\" data-end=\"1505\">Yinelenen i\u00e7eri\u011fe veya<\/strong> sunucu y\u00fck\u00fcne neden olabilecek gereksiz taramay\u0131 azalt\u0131r<\/p><\/li><\/ul><p data-start=\"1522\" data-end=\"1650\"><strong data-start=\"1526\" data-end=\"1566\">Robots.txt dosyas\u0131 arama motorlar\u0131na nelere<\/strong> eri\u015fip <strong data-start=\"1526\" data-end=\"1566\">nelere eri\u015femeyeceklerini s\u00f6yler<\/strong> &#8211; ancak <strong data-start=\"1608\" data-end=\"1649\">dizine eklemeye veya dizinden \u00e7\u0131karmaya zorlamaz.<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-22f49dd9 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"22f49dd9\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-4049dd0a\" data-id=\"4049dd0a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7ecc3baa elementor-widget elementor-widget-heading\" data-id=\"7ecc3baa\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Web Sitenizin Neden robots.txt Dosyas\u0131na \u0130htiyac\u0131 Var?<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-1964306b elementor-widget elementor-widget-text-editor\" data-id=\"1964306b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"1702\" data-end=\"1851\">Her web sitesi bir <strong data-start=\"1726\" data-end=\"1742\">tarama b\u00fct\u00e7esiyle<\/strong> \u00e7al\u0131\u015f\u0131r <strong data-start=\"1726\" data-end=\"1742\">,<\/strong> yani <strong data-start=\"1772\" data-end=\"1785\">Googlebot ve Bing<\/strong> gibi arama motorlar\u0131n\u0131n ziyaret ettikleri URL <strong data-start=\"1806\" data-end=\"1821\">say\u0131s\u0131 i\u00e7in<\/strong> bir tarama <strong data-start=\"1806\" data-end=\"1821\">s\u0131n\u0131r\u0131<\/strong> <strong data-start=\"1790\" data-end=\"1798\">vard\u0131r<\/strong>.<\/p><p data-start=\"1853\" data-end=\"1897\"><strong data-start=\"1859\" data-end=\"1883\">Robots.txt&#8217;yi do\u011fru<\/strong> kullanmak <strong data-start=\"1859\" data-end=\"1883\">bunu sa\u011flar<\/strong>:<\/p><ul data-start=\"1898\" data-end=\"2085\"><li data-start=\"1898\" data-end=\"1950\"><p data-start=\"1900\" data-end=\"1950\">Arama motorlar\u0131 <strong data-start=\"1915\" data-end=\"1950\">\u00f6nemli sayfalar\u0131 tarar ve dizine ekler<\/strong><\/p><\/li><li data-start=\"1951\" data-end=\"1979\"><p data-start=\"1953\" data-end=\"1979\">D\u00fc\u015f\u00fck de\u011ferli URL&#8217;ler g\u00f6z ard\u0131 edilir<\/p><\/li><li data-start=\"1980\" data-end=\"2033\"><p data-start=\"1982\" data-end=\"2033\"><strong data-start=\"1982\" data-end=\"2003\">Yinelenen i\u00e7erik URL&#8217;leri<\/strong> tarama b\u00fct\u00e7esini bo\u015fa harcamaz<\/p><\/li><li data-start=\"2034\" data-end=\"2085\"><p data-start=\"2036\" data-end=\"2085\">Sunucu kaynaklar\u0131 agresif botlar taraf\u0131ndan bo\u015fa harcanmaz<\/p><\/li><\/ul><p data-start=\"2087\" data-end=\"2171\">Do\u011fru kullan\u0131ld\u0131\u011f\u0131nda <strong data-start=\"2108\" data-end=\"2135\">robots.txt SEO&#8217;yu, performans\u0131<\/strong> ve tarama verimlili\u011fini <strong data-start=\"2108\" data-end=\"2135\">art\u0131r\u0131r<\/strong>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-349232d3 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"349232d3\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-70d0e4f6\" data-id=\"70d0e4f6\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-531468e elementor-widget elementor-widget-heading\" data-id=\"531468e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Bu \u00dccretsiz Robots.txt Olu\u015fturucu Ne Yapar?<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-475cabd4 elementor-widget elementor-widget-text-editor\" data-id=\"475cabd4\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"2223\" data-end=\"2272\"><strong data-start=\"2227\" data-end=\"2261\">\u00dccretsiz robots.txt dosya olu\u015fturucumuz size yard\u0131mc\u0131 olur<\/strong>:<\/p><ul data-start=\"2274\" data-end=\"2617\"><li data-start=\"2274\" data-end=\"2315\"><p data-start=\"2276\" data-end=\"2315\"><strong data-start=\"2276\" data-end=\"2315\">Robots.txt dosyalar\u0131n\u0131 an\u0131nda olu\u015fturun<\/strong><\/p><\/li><li data-start=\"2316\" data-end=\"2377\"><p data-start=\"2318\" data-end=\"2377\">Do\u011fru <strong data-start=\"2356\" data-end=\"2377\">robots.txt s\u00f6zdizimini<\/strong> <strong data-start=\"2325\" data-end=\"2341\">kullanarak \u00f6zel kurallar<\/strong> olu\u015fturma<\/p><\/li><li data-start=\"2378\" data-end=\"2417\"><p data-start=\"2380\" data-end=\"2417\"><strong data-start=\"2384\" data-end=\"2417\">\u0130zin ver ve izin verme y\u00f6nergeleri<\/strong> ekleyin<\/p><\/li><li data-start=\"2418\" data-end=\"2486\"><p data-start=\"2420\" data-end=\"2486\"><strong data-start=\"2441\" data-end=\"2486\">Googlebot, Bing ve di\u011fer arama motorlar\u0131<\/strong> i\u00e7in tarama kontrol\u00fc<\/p><\/li><li data-start=\"2487\" data-end=\"2531\"><p data-start=\"2489\" data-end=\"2531\">SEO&#8217;ya zarar vermeden yapay zeka e\u011fitim botlar\u0131n\u0131 engelleyin<\/p><\/li><li data-start=\"2532\" data-end=\"2568\"><p data-start=\"2534\" data-end=\"2568\"><strong data-start=\"2543\" data-end=\"2568\">Tarama ve indekslemeyi<\/strong> optimize edin<\/p><\/li><li data-start=\"2569\" data-end=\"2617\"><p data-start=\"2571\" data-end=\"2617\"><strong data-start=\"2600\" data-end=\"2617\">Web<\/strong> sitenizin <strong data-start=\"2600\" data-end=\"2617\">ihtiya\u00e7lar\u0131na<\/strong> g\u00f6re kurallar olu\u015fturun<\/p><\/li><\/ul><p data-start=\"2619\" data-end=\"2719\">Bu ara\u00e7 <strong data-start=\"2669\" data-end=\"2701\">,<\/strong> sadece teoriye de\u011fil <strong data-start=\"2669\" data-end=\"2701\">, ger\u00e7ek d\u00fcnyadaki tarama davran\u0131\u015f\u0131na<\/strong> <strong data-start=\"2643\" data-end=\"2657\">odaklanan<\/strong> bir <strong data-start=\"2643\" data-end=\"2657\">SEO uzman\u0131<\/strong> taraf\u0131ndan olu\u015fturulmu\u015ftur <strong data-start=\"2669\" data-end=\"2701\">.<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-35295016 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"35295016\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-1b9866ab\" data-id=\"1b9866ab\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-2ead07d9 elementor-widget elementor-widget-heading\" data-id=\"2ead07d9\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Robots.txt Nas\u0131l \u00c7al\u0131\u015f\u0131r (H\u0131zl\u0131 A\u00e7\u0131klama)<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-3036d2d3 elementor-widget elementor-widget-text-editor\" data-id=\"3036d2d3\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"2771\" data-end=\"2798\">Bir robots.txt dosyas\u0131 \u015funlar\u0131 i\u00e7erir:<\/p><ul data-start=\"2799\" data-end=\"2970\"><li data-start=\"2799\" data-end=\"2847\"><p data-start=\"2801\" data-end=\"2847\"><strong data-start=\"2801\" data-end=\"2815\">Kullan\u0131c\u0131 arac\u0131s\u0131 (<\/strong> kural\u0131n hangi bot i\u00e7in ge\u00e7erli oldu\u011fu)<\/p><\/li><li data-start=\"2848\" data-end=\"2915\"><p data-start=\"2850\" data-end=\"2915\"><strong data-start=\"2850\" data-end=\"2864\">Y\u00f6nergeler (<\/strong> <code data-start=\"2877\" data-end=\"2884\">Allow<\/code>, <code data-start=\"2886\" data-end=\"2896\">Disallow<\/code> veya <code data-start=\"2901\" data-end=\"2914\">Crawl-delay<\/code> gibi kurallar)<\/p><\/li><li data-start=\"2916\" data-end=\"2970\"><p data-start=\"2918\" data-end=\"2970\"><strong data-start=\"2947\" data-end=\"2970\">Site haritan\u0131z\u0131n URL&#8217;si<\/strong> gibi iste\u011fe ba\u011fl\u0131 referanslar<\/p><\/li><\/ul><p data-start=\"2972\" data-end=\"2980\">\u00d6rnek:<\/p><div class=\"contain-inline-size rounded-2xl corner-superellipse\/1.1 relative bg-token-sidebar-surface-primary\"><div class=\"@w-xl\/main:top-9 sticky top-[calc(--spacing(9)+var(--header-height))]\"><div class=\"absolute end-0 bottom-0 flex h-9 items-center pe-2\"><div class=\"bg-token-bg-elevated-secondary text-token-text-secondary flex items-center gap-4 rounded-sm px-2 font-sans text-xs\"> <\/div><\/div><\/div><div class=\"overflow-y-auto p-4\" dir=\"ltr\"><code class=\"whitespace-pre! language-txt\">User-agent: Googlebot\nAllow: \/\n\nUser-agent: *\nDisallow: \/wp-admin\/\n<\/code><\/div><\/div><p data-start=\"3060\" data-end=\"3176\">Her <strong data-start=\"3065\" data-end=\"3078\">y\u00f6nerge<\/strong> <strong data-start=\"3087\" data-end=\"3113\">belirli<\/strong> bir <strong data-start=\"3087\" data-end=\"3113\">arama motoruna veya<\/strong> taray\u0131c\u0131ya <strong data-start=\"3156\" data-end=\"3175\">sitenizi taramaya<\/strong> \u00e7al\u0131\u015ft\u0131\u011f\u0131nda nas\u0131l davranmas\u0131 gerekti\u011fini <strong data-start=\"3065\" data-end=\"3078\">s\u00f6yler<\/strong> <strong data-start=\"3156\" data-end=\"3175\">.<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-75221af3 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"75221af3\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-1f661613\" data-id=\"1f661613\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-4cd0c3f3 elementor-widget elementor-widget-heading\" data-id=\"4cd0c3f3\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Yayg\u0131n robots.txt Y\u00f6nergeleri A\u00e7\u0131kland\u0131<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-2544a7ff elementor-widget elementor-widget-text-editor\" data-id=\"2544a7ff\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<h3 data-start=\"3226\" data-end=\"3240\">Kullan\u0131c\u0131 arac\u0131s\u0131<\/h3><p data-start=\"3241\" data-end=\"3339\"><strong data-start=\"3255\" data-end=\"3262\">Kural\u0131n<\/strong> hangi <strong data-start=\"3255\" data-end=\"3262\">bot<\/strong> i\u00e7in ge\u00e7erli oldu\u011funu tan\u0131mlar (\u00f6rne\u011fin, t\u00fcm taray\u0131c\u0131lar i\u00e7in <code data-start=\"3290\" data-end=\"3301\">Googlebot<\/code>, <code data-start=\"3303\" data-end=\"3312\">Bingbot<\/code> veya <code data-start=\"3317\" data-end=\"3320\">*<\/code> ).<\/p><h3 data-start=\"3341\" data-end=\"3353\">\u0130zin Verme<\/h3><p data-start=\"3354\" data-end=\"3460\">Taray\u0131c\u0131lar\u0131n bir <strong data-start=\"3422\" data-end=\"3429\">URL&#8217;ye,<\/strong> <strong data-start=\"3431\" data-end=\"3441\">klas\u00f6re veya dizine<\/strong> eri\u015fmesini engellemek <strong data-start=\"3362\" data-end=\"3384\">i\u00e7in disallow y\u00f6nergesini<\/strong> kullan\u0131n <strong data-start=\"3446\" data-end=\"3459\">.<\/strong><\/p><h3 data-start=\"3462\" data-end=\"3471\">\u0130zin ver<\/h3><p data-start=\"3472\" data-end=\"3539\">Dizine eklenmesini istedi\u011finiz belirli URL&#8217;ler i\u00e7in izin vermeme kural\u0131n\u0131 ge\u00e7ersiz k\u0131lar.<\/p><h3 data-start=\"3541\" data-end=\"3556\">S\u00fcr\u00fcnme gecikmesi<\/h3><p data-start=\"3557\" data-end=\"3638\">Bir taray\u0131c\u0131n\u0131n sayfalar\u0131 ne kadar h\u0131zl\u0131 isteyece\u011fini kontrol eder (y\u00fck alt\u0131ndaki sunucular i\u00e7in kullan\u0131\u015fl\u0131d\u0131r).<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-14c7d353 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"14c7d353\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-56af137c\" data-id=\"56af137c\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-3dc7270 elementor-widget elementor-widget-heading\" data-id=\"3dc7270\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Robots.txt Dosyas\u0131 Nereye Y\u00fcklenir<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-51ea17c2 elementor-widget elementor-widget-text-editor\" data-id=\"51ea17c2\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"3685\" data-end=\"3728\"><strong data-start=\"3694\" data-end=\"3717\">Robots.txt dosyas\u0131n\u0131 olu\u015fturduktan<\/strong> sonra <strong data-start=\"3694\" data-end=\"3717\">, \u015funlar\u0131 yapmal\u0131s\u0131n\u0131z<\/strong>:<\/p><ol data-start=\"3730\" data-end=\"3930\"><li data-start=\"3730\" data-end=\"3777\"><p data-start=\"3733\" data-end=\"3777\"><strong data-start=\"3746\" data-end=\"3758\">Ad\u0131nda<\/strong> bir <strong data-start=\"3746\" data-end=\"3758\">txt dosyas\u0131<\/strong> olarak kaydedin  <code data-start=\"3765\" data-end=\"3777\">robots.txt<\/code><\/p><\/li><li data-start=\"3778\" data-end=\"3894\"><p data-start=\"3781\" data-end=\"3846\">Robots.txt dosyas\u0131n\u0131 <strong data-start=\"3815\" data-end=\"3846\">web sitenizin<\/strong> k\u00f6k <strong data-start=\"3815\" data-end=\"3846\">klas\u00f6r\u00fcne<\/strong> y\u00fckleyin<\/p><div class=\"contain-inline-size rounded-2xl corner-superellipse\/1.1 relative bg-token-sidebar-surface-primary\"><div class=\"@w-xl\/main:top-9 sticky top-[calc(--spacing(9)+var(--header-height))]\"><div class=\"absolute end-0 bottom-0 flex h-9 items-center pe-2\"><div class=\"bg-token-bg-elevated-secondary text-token-text-secondary flex items-center gap-4 rounded-sm px-2 font-sans text-xs\"> <\/div><\/div><\/div><div class=\"overflow-y-auto p-4\" dir=\"ltr\"><code class=\"whitespace-pre!\">https:<span class=\"hljs-comment\">\/\/example.com\/robots.txt<\/span>\n<\/code><\/div><\/div><\/li><li data-start=\"3895\" data-end=\"3930\"><p data-start=\"3898\" data-end=\"3930\">Herkesin eri\u015fimine a\u00e7\u0131k oldu\u011fundan emin olun<\/p><\/li><\/ol><p data-start=\"3932\" data-end=\"3992\">Bu dosya bir alt klas\u00f6r\u00fcn i\u00e7inde de\u011fil <strong data-start=\"3959\" data-end=\"3967\">, k\u00f6k<\/strong> dizinde bulunmal\u0131d\u0131r.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-4627379b elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"4627379b\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-66ad0721\" data-id=\"66ad0721\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-31db8715 elementor-widget elementor-widget-heading\" data-id=\"31db8715\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Robots.txt Dosyan\u0131z\u0131 Google'a G\u00f6nderin<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-18b44bd6 elementor-widget elementor-widget-text-editor\" data-id=\"18b44bd6\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"4041\" data-end=\"4096\"><strong data-start=\"4051\" data-end=\"4083\">Robots.txt dosyan\u0131z\u0131 g\u00fcncelledikten<\/strong> sonra <strong data-start=\"4051\" data-end=\"4083\">yapmal\u0131s\u0131n\u0131z:<\/strong><\/p><ul data-start=\"4098\" data-end=\"4243\"><li data-start=\"4098\" data-end=\"4130\"><p data-start=\"4100\" data-end=\"4130\"><strong data-start=\"4105\" data-end=\"4130\">Google Search Console&#8217;u<\/strong> a\u00e7\u0131n<\/p><\/li><li data-start=\"4131\" data-end=\"4162\"><p data-start=\"4133\" data-end=\"4162\"><strong data-start=\"4141\" data-end=\"4162\">Robots.txt test<\/strong> arac\u0131n\u0131 kullan\u0131n<\/p><\/li><li data-start=\"4163\" data-end=\"4188\"><p data-start=\"4165\" data-end=\"4188\">Dosyay\u0131 g\u00f6nderin veya test edin<\/p><\/li><li data-start=\"4189\" data-end=\"4243\"><p data-start=\"4191\" data-end=\"4243\"><strong data-start=\"4203\" data-end=\"4220\">Google araman\u0131n<\/strong> izin verilen URL&#8217;leri <strong data-start=\"4203\" data-end=\"4220\">tarayabildi\u011fini<\/strong> do\u011frulay\u0131n<\/p><\/li><\/ul><p data-start=\"4245\" data-end=\"4350\"><strong data-start=\"4260\" data-end=\"4304\">Robots.txt dosyas\u0131n\u0131n Google Search Console&#8217;a<\/strong> g\u00f6nderilmesi <strong data-start=\"4260\" data-end=\"4304\">,<\/strong> Google&#8217;\u0131n en son s\u00fcr\u00fcm\u00fc <strong data-start=\"4260\" data-end=\"4304\">okumas\u0131n\u0131 sa\u011flar<\/strong>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-6f57f64 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"6f57f64\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-0871e50\" data-id=\"0871e50\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-39cf06b elementor-widget elementor-widget-heading\" data-id=\"39cf06b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">robots.txt vs \u0130ndeksleme (\u00d6nemli)<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-48af0d8 elementor-widget elementor-widget-text-editor\" data-id=\"48af0d8\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"4396\" data-end=\"4413\">Robots.txt kullanarak:<\/p><ul data-start=\"4414\" data-end=\"4576\"><li data-start=\"4414\" data-end=\"4479\"><p data-start=\"4416\" data-end=\"4479\">\u274c Bir sayfan\u0131n arama sonu\u00e7lar\u0131ndan kald\u0131r\u0131laca\u011f\u0131n\u0131 garanti etmez<\/p><\/li><li data-start=\"4480\" data-end=\"4519\"><p data-start=\"4482\" data-end=\"4519\">\u2705 <strong data-start=\"4493\" data-end=\"4505\">Taramay\u0131<\/strong> kontrol eder <strong data-start=\"4493\" data-end=\"4505\">,<\/strong> indekslemeyi de\u011fil<\/p><\/li><li data-start=\"4520\" data-end=\"4576\"><p data-start=\"4522\" data-end=\"4576\">\u2705 <strong data-start=\"4530\" data-end=\"4576\">Arama motorlar\u0131n\u0131n verimli bir \u015fekilde taramas\u0131na ve indekslemesine<\/strong> yard\u0131mc\u0131 olur<\/p><\/li><\/ul><p data-start=\"4578\" data-end=\"4642\">Bir sayfan\u0131n <strong data-start=\"4595\" data-end=\"4627\">arama sonu\u00e7lar\u0131nda g\u00f6r\u00fcnmemesi<\/strong> gerekiyorsa <strong data-start=\"4595\" data-end=\"4627\">,<\/strong> ihtiyac\u0131n\u0131z olabilir:<\/p><ul data-start=\"4643\" data-end=\"4726\"><li data-start=\"4643\" data-end=\"4664\"><p data-start=\"4645\" data-end=\"4664\"><code data-start=\"4645\" data-end=\"4654\">noindex<\/code>  meta etiketler<\/p><\/li><li data-start=\"4665\" data-end=\"4688\"><p data-start=\"4667\" data-end=\"4688\">Uygun kanonik URL&#8217;ler<\/p><\/li><li data-start=\"4689\" data-end=\"4726\"><p data-start=\"4691\" data-end=\"4726\"><strong data-start=\"4708\" data-end=\"4726\">Search<\/strong> Console&#8217;daki kald\u0131rma ara\u00e7lar\u0131<\/p><\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-097ec62 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"097ec62\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-0994d33\" data-id=\"0994d33\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-b878e97 elementor-widget elementor-widget-heading\" data-id=\"b878e97\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">robots.txt ve Yinelenen \u0130\u00e7erik<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-0dddd26 elementor-widget elementor-widget-text-editor\" data-id=\"0dddd26\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"4770\" data-end=\"4815\">Do\u011fru yap\u0131land\u0131r\u0131lm\u0131\u015f bir robots.txt dosyas\u0131 yard\u0131mc\u0131 olur:<\/p><ul data-start=\"4816\" data-end=\"4950\"><li data-start=\"4816\" data-end=\"4852\"><p data-start=\"4818\" data-end=\"4852\">URL parametrelerinin taranmas\u0131n\u0131 \u00f6nleme<\/p><\/li><li data-start=\"4853\" data-end=\"4896\"><p data-start=\"4855\" data-end=\"4896\">Arama ve filtre URL&#8217;lerinin taranmas\u0131n\u0131 azalt\u0131n<\/p><\/li><li data-start=\"4897\" data-end=\"4950\"><p data-start=\"4899\" data-end=\"4950\">Tarama b\u00fct\u00e7esini <strong data-start=\"4929\" data-end=\"4950\">yinelenen i\u00e7erik<\/strong> i\u00e7in harcamaktan ka\u00e7\u0131n\u0131n<\/p><\/li><\/ul><p data-start=\"4952\" data-end=\"5021\">Bu \u00f6zellikle b\u00fcy\u00fck web siteleri ve e-ticaret ma\u011fazalar\u0131 i\u00e7in \u00f6nemlidir.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-55800a3 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"55800a3\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-4216443\" data-id=\"4216443\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-e064f7e elementor-widget elementor-widget-heading\" data-id=\"e064f7e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Yapay Zeka Taray\u0131c\u0131lar\u0131, Botlar ve Sunucu Y\u00fck\u00fc<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-473f43b elementor-widget elementor-widget-text-editor\" data-id=\"473f43b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"5067\" data-end=\"5135\">Modern web siteleri sadece arama motorlar\u0131 taraf\u0131ndan de\u011fil, ayn\u0131 zamanda arama motorlar\u0131 taraf\u0131ndan da taranmaktad\u0131r:<\/p><ul data-start=\"5136\" data-end=\"5187\"><li data-start=\"5136\" data-end=\"5154\"><p data-start=\"5138\" data-end=\"5154\">Yapay zeka e\u011fitim botlar\u0131<\/p><\/li><li data-start=\"5155\" data-end=\"5165\"><p data-start=\"5157\" data-end=\"5165\">S\u0131y\u0131r\u0131c\u0131lar<\/p><\/li><li data-start=\"5166\" data-end=\"5187\"><p data-start=\"5168\" data-end=\"5187\">Agresif taray\u0131c\u0131lar<\/p><\/li><\/ul><p data-start=\"5189\" data-end=\"5347\">Bu <strong data-start=\"5194\" data-end=\"5218\">robots.txt olu\u015fturucu<\/strong>, yapay zeka taray\u0131c\u0131lar\u0131n\u0131 <strong data-start=\"5194\" data-end=\"5218\">engellemeye yard\u0131mc\u0131 olurken<\/strong> Google <strong data-start=\"5263\" data-end=\"5298\">ve di\u011fer arama motorlar\u0131n\u0131n<\/strong> i\u00e7eri\u011finizi d\u00fczg\u00fcn <strong data-start=\"5263\" data-end=\"5298\">bir \u015fekilde taramas\u0131n\u0131<\/strong> ve dizine <strong data-start=\"5263\" data-end=\"5298\">eklemesini<\/strong> sa\u011flar.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-0d261dc elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"0d261dc\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-1794b11\" data-id=\"1794b11\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-adc3f76 elementor-widget elementor-widget-heading\" data-id=\"adc3f76\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Robots.txt'i Ne Zaman Kullanmal\u0131s\u0131n\u0131z?<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-7e526b8 elementor-widget elementor-widget-text-editor\" data-id=\"7e526b8\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"5389\" data-end=\"5407\">E\u011fer robots.txt kullan\u0131n:<\/p><ul data-start=\"5408\" data-end=\"5643\"><li data-start=\"5408\" data-end=\"5450\"><p data-start=\"5410\" data-end=\"5450\">Sitenizin baz\u0131 b\u00f6l\u00fcmleri taranmamal\u0131d\u0131r<\/p><\/li><li data-start=\"5451\" data-end=\"5489\"><p data-start=\"5453\" data-end=\"5489\">Siteniz <strong data-start=\"5473\" data-end=\"5489\">tarama b\u00fct\u00e7<\/strong>esiyle \u00e7al\u0131\u015f\u0131yor<\/p><\/li><li data-start=\"5490\" data-end=\"5549\"><p data-start=\"5492\" data-end=\"5549\"><strong data-start=\"5516\" data-end=\"5542\">Arama motoru taray\u0131c\u0131lar\u0131n\u0131n<\/strong> nas\u0131l <strong data-start=\"5516\" data-end=\"5542\">davranaca\u011f\u0131n\u0131<\/strong> kontrol etmek istiyorsunuz<\/p><\/li><li data-start=\"5550\" data-end=\"5596\"><p data-start=\"5552\" data-end=\"5596\">Belirli sayfalara botlar taraf\u0131ndan eri\u015filmemelidir<\/p><\/li><li data-start=\"5597\" data-end=\"5643\"><p data-start=\"5599\" data-end=\"5643\">Tarama verimlili\u011fini ve SEO&#8217;yu iyile\u015ftirmek istiyorsunuz<\/p><\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-0c4940e elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"0c4940e\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-930092a\" data-id=\"930092a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-83550c3 elementor-widget elementor-widget-heading\" data-id=\"83550c3\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Robots.txt Dosyan\u0131z\u0131 \u015eimdi Olu\u015fturun<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-b701be9 elementor-widget elementor-widget-text-editor\" data-id=\"b701be9\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"5688\" data-end=\"5735\"><strong data-start=\"5696\" data-end=\"5725\">Yukar\u0131daki \u00fccretsiz robots.txt olu\u015fturucumuzu<\/strong> kullan\u0131n <strong data-start=\"5696\" data-end=\"5725\">:<\/strong> <\/p><ul data-start=\"5737\" data-end=\"5920\"><li data-start=\"5737\" data-end=\"5767\"><p data-start=\"5739\" data-end=\"5767\"><strong data-start=\"5739\" data-end=\"5767\">Bir robots.txt dosyas\u0131 olu\u015fturun<\/strong><\/p><\/li><li data-start=\"5768\" data-end=\"5803\"><p data-start=\"5770\" data-end=\"5803\">Sitenize g\u00f6re kurallar olu\u015fturun<\/p><\/li><li data-start=\"5804\" data-end=\"5837\"><p data-start=\"5806\" data-end=\"5837\">Da\u011f\u0131tmadan \u00f6nce dosyan\u0131z\u0131 test edin<\/p><\/li><li data-start=\"5838\" data-end=\"5869\"><p data-start=\"5840\" data-end=\"5869\">Tarama ve indekslemeyi iyile\u015ftirme<\/p><\/li><li data-start=\"5870\" data-end=\"5920\"><p data-start=\"5872\" data-end=\"5920\">Google ve Bing&#8217;in do\u011fru URL&#8217;leri tarad\u0131\u011f\u0131ndan emin olun<\/p><\/li><\/ul><p data-start=\"5922\" data-end=\"6004\">Bu ara\u00e7 <strong data-start=\"5942\" data-end=\"5981\">, g\u00fcvenli bir \u015fekilde ve<\/strong> an\u0131nda <strong data-start=\"5942\" data-end=\"5981\">etkili robots.txt dosyalar\u0131 olu\u015fturman\u0131za<\/strong> yard\u0131mc\u0131 olur.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-e7ce08d elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"e7ce08d\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-64dc156a\" data-id=\"64dc156a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-45ea0e2a elementor-widget elementor-widget-heading\" data-id=\"45ea0e2a\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">SSS<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-2591eca elementor-widget elementor-widget-html\" data-id=\"2591eca\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"html.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<script type=\"application\/ld+json\">{\r\n  \"@context\": \"https:\/\/schema.org\",\r\n  \"@type\": \"FAQPage\",\r\n  \"mainEntity\": [\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"What is a robots.txt file?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"A robots.txt file is a text file placed in the root folder of your website that tells search engine crawlers which parts of your site they are allowed or not allowed to crawl, based on the robots exclusion protocol.\"\r\n      }\r\n    },\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"Does robots.txt affect SEO?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"Yes. robots.txt affects SEO by controlling crawling behavior, crawl budget usage, and which URLs search engines can access. It does not directly control indexing but helps search engines crawl your website efficiently.\"\r\n      }\r\n    },\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"Can robots.txt block Google from indexing my website?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"robots.txt can prevent Googlebot from crawling URLs, but it does not guarantee removal from search results. To control indexing, use noindex meta tags or Google Search Console removal tools.\"\r\n      }\r\n    },\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"Where should I upload the robots.txt file?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"The robots.txt file must be uploaded to the root folder of your website, for example: https:\/\/example.com\/robots.txt. Search engines will only check this location.\"\r\n      }\r\n    },\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"Should I block AI crawlers using robots.txt?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"Blocking AI crawlers using robots.txt can reduce unnecessary crawling and server load. However, enforcement is stronger when combined with Cloudflare WAF or bot protection settings.\"\r\n      }\r\n    },\r\n    {\r\n      \"@type\": \"Question\",\r\n      \"name\": \"How do I test my robots.txt file?\",\r\n      \"acceptedAnswer\": {\r\n        \"@type\": \"Answer\",\r\n        \"text\": \"You can test your robots.txt file using the robots.txt tester inside Google Search Console to verify that Googlebot can crawl important URLs and that disallowed rules are working correctly.\"\r\n      }\r\n    }\r\n  ]\r\n}\r\n<\/script>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-inner-section elementor-element elementor-element-293be7ee elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"293be7ee\" data-element_type=\"section\" data-e-type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-inner-column elementor-element elementor-element-43950af2\" data-id=\"43950af2\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-1d21b482 elementor-widget elementor-widget-heading\" data-id=\"1d21b482\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Sonu\u00e7<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<div class=\"elementor-element elementor-element-5b0fee02 elementor-widget elementor-widget-text-editor\" data-id=\"5b0fee02\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul data-start=\"6031\" data-end=\"6268\"><li data-start=\"6031\" data-end=\"6078\"><p data-start=\"6033\" data-end=\"6078\">robots.txt, <strong data-start=\"6059\" data-end=\"6078\">taray\u0131c\u0131lar\u0131<\/strong> y\u00f6nlendiren bir dosyad\u0131r<\/p><\/li><li data-start=\"6079\" data-end=\"6125\"><p data-start=\"6081\" data-end=\"6125\">Do\u011fru <strong data-start=\"6104\" data-end=\"6125\">robots.txt s\u00f6zdizimini<\/strong> takip etmelidir<\/p><\/li><li data-start=\"6126\" data-end=\"6176\"><p data-start=\"6128\" data-end=\"6176\">De\u011fi\u015fiklikleri her zaman <strong data-start=\"6151\" data-end=\"6176\">Google Search Console<\/strong>&#8216;da test edin<\/p><\/li><li data-start=\"6177\" data-end=\"6268\"><p data-start=\"6179\" data-end=\"6268\">\u0130yi yap\u0131land\u0131r\u0131lm\u0131\u015f bir robots.txt, arama <strong data-start=\"6221\" data-end=\"6268\">motorlar\u0131n\u0131n \u00f6nemli olanlar\u0131 taramas\u0131n\u0131 ve dizine eklemesini<\/strong> sa\u011flar<\/p><\/li><\/ul><p data-start=\"6270\" data-end=\"6435\">Dizine eklenmek, tarama davran\u0131\u015f\u0131n\u0131 kontrol etmek ve sunucunuzu korumak istiyorsan\u0131z, bug\u00fcn <strong data-start=\"6347\" data-end=\"6384\">temiz, SEO a\u00e7\u0131s\u0131ndan g\u00fcvenli bir<\/strong> robots.txt dosyas\u0131 <strong data-start=\"6347\" data-end=\"6384\">olu\u015fturmak i\u00e7in<\/strong> \u00fccretsiz <strong data-start=\"6347\" data-end=\"6384\">robots.txt olu\u015fturucumuzu<\/strong> kullan\u0131n.<\/p><p data-start=\"193\" data-end=\"611\"><strong data-start=\"208\" data-end=\"229\">Robots.txt dosyas\u0131n\u0131n<\/strong> nas\u0131l <strong data-start=\"208\" data-end=\"229\">do\u011fru olu\u015fturulaca\u011f\u0131n\u0131<\/strong> bilmek, taramay\u0131 kontrol etmek ve <strong data-start=\"312\" data-end=\"332\">SEO&#8217;nuzu<\/strong> geli\u015ftirmek isteyen herhangi bir web sitesi i\u00e7in \u00f6nemli bir ad\u0131md\u0131r <strong data-start=\"312\" data-end=\"332\">.<\/strong> <strong data-start=\"343\" data-end=\"371\">Bir robots.txt dosyas\u0131 olu\u015fturdu\u011funuzda,<\/strong> Google gibi arama motoru taray\u0131c\u0131lar\u0131 i\u00e7in <strong data-start=\"392\" data-end=\"414\">net talimatlar i\u00e7eren<\/strong> ve <strong data-start=\"508\" data-end=\"533\">web<\/strong> sitenizdeki hangi sayfalar\u0131n <strong data-start=\"508\" data-end=\"533\">taranmas\u0131<\/strong> ve <strong data-start=\"562\" data-end=\"593\">web sit<\/strong> elerinin hangi b\u00f6l\u00fcm\u00fcn\u00fcn <strong data-start=\"562\" data-end=\"593\">k\u0131s\u0131tlanmas\u0131 gerekti\u011fini<\/strong> <strong data-start=\"461\" data-end=\"476\">anlamalar\u0131na yard\u0131mc\u0131 olan<\/strong> bir dosya tan\u0131mlam\u0131\u015f <strong data-start=\"343\" data-end=\"371\">olursunuz<\/strong>. <\/p><p data-start=\"613\" data-end=\"960\"><strong data-start=\"616\" data-end=\"650\">Robots.txt dosyas\u0131n\u0131 olu\u015fturarak,<\/strong> <strong data-start=\"675\" data-end=\"694\">botlar i\u00e7in kurallar\u0131 listeleyen<\/strong> bir dosyay\u0131 kolayca <strong data-start=\"616\" data-end=\"650\">olu\u015fturabilir<\/strong>, tarama <strong data-start=\"727\" data-end=\"753\">s\u0131n\u0131r\u0131na<\/strong> g\u00f6re taramay\u0131 y\u00f6netebilir <strong data-start=\"727\" data-end=\"753\">ve<\/strong> gereksiz URL&#8217;lerde tarama b\u00fct\u00e7esini <strong data-start=\"727\" data-end=\"753\">bo\u015fa harcamaktan ka\u00e7\u0131nabilirsiniz.<\/strong> Kural eklerken, hatalar\u0131 \u00f6nlemek i\u00e7in <strong data-start=\"838\" data-end=\"863\">ileri e\u011fik \u00e7izgi<\/strong> eklemeyi <strong data-start=\"838\" data-end=\"863\">ve<\/strong> izin vermek veya engellemek <strong data-start=\"886\" data-end=\"914\">istedi\u011finiz dizinin<\/strong> tam <strong data-start=\"886\" data-end=\"914\">adresini<\/strong> <strong data-start=\"838\" data-end=\"863\">belirtmeyi<\/strong> unutmay\u0131n. <\/p><p data-start=\"962\" data-end=\"1254\">Kurallar\u0131n\u0131z kesinle\u015ftikten sonra, her zaman <strong data-start=\"1000\" data-end=\"1028\">arama motorlar\u0131na bir robots.txt dosyas\u0131 g\u00f6nderin<\/strong> ve uygun davran\u0131\u015f\u0131 sa\u011flamak i\u00e7in test ara\u00e7lar\u0131n\u0131 kullanarak do\u011frulay\u0131n. \u0130yi yap\u0131land\u0131r\u0131lm\u0131\u015f bir robots.txt dosyas\u0131 size daha iyi tarama kontrol\u00fc, daha temiz indeksleme ve uzun vadeli SEO ba\u015far\u0131s\u0131 i\u00e7in daha g\u00fc\u00e7l\u00fc bir teknik temel sa\u011flar. <\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/main>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Taraf\u0131ndan yaz\u0131ld\u0131 Tarama b\u00fct\u00e7esini bo\u015fa harcamadan veya sitenizin hassas k\u0131s\u0131mlar\u0131n\u0131 a\u00e7\u0131\u011fa \u00e7\u0131karmadan , Google ve di\u011fer arama motorlar\u0131n\u0131n web sitenizi do\u011fru bir \u015fekilde taramas\u0131na ve dizine eklemesine yard\u0131mc\u0131 olan bir robots.txt dosyas\u0131n\u0131 an\u0131nda olu\u015fturmak i\u00e7in \u00fccretsiz robots.txt olu\u015fturucumuzu kullan\u0131n. Bu kullan\u0131m\u0131 kolay ara\u00e7 , robots d\u0131\u015flama protokol\u00fcn\u00fc (robots d\u0131\u015flama protokol\u00fc veya standard\u0131 olarak da adland\u0131r\u0131l\u0131r) [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":400593,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"elementor_header_footer","meta":{"_acf_changed":false,"footnotes":""},"class_list":["post-401908","page","type-page","status-publish","has-post-thumbnail","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/barrazacarlos.com\/tr\/wp-json\/wp\/v2\/pages\/401908","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/barrazacarlos.com\/tr\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/barrazacarlos.com\/tr\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/barrazacarlos.com\/tr\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/barrazacarlos.com\/tr\/wp-json\/wp\/v2\/comments?post=401908"}],"version-history":[{"count":0,"href":"https:\/\/barrazacarlos.com\/tr\/wp-json\/wp\/v2\/pages\/401908\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/barrazacarlos.com\/tr\/wp-json\/wp\/v2\/media\/400593"}],"wp:attachment":[{"href":"https:\/\/barrazacarlos.com\/tr\/wp-json\/wp\/v2\/media?parent=401908"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}