{"id":277,"date":"2020-03-31T13:00:21","date_gmt":"2020-03-31T11:00:21","guid":{"rendered":"http:\/\/carontestudio.com\/blog\/?p=277"},"modified":"2025-07-15T13:44:08","modified_gmt":"2025-07-15T11:44:08","slug":"robots-txt-que-es-como-funciona","status":"publish","type":"post","link":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/","title":{"rendered":"Robots.txt: qu\u00e9 es y c\u00f3mo funciona"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">\u00bfQu\u00e9 es el archivo robots.txt?<\/h2>\n\n\n\n<p>Se trata de un archivo de texto que se aloja en la ra\u00edz de nuestro sitio web. En este documento marcaremos unas directrices para sugerir a los robots o ara\u00f1as <strong>qu\u00e9 partes de nuestra web no deben rastrear<\/strong> e indexar. <\/p>\n\n\n\n<p>Es un archivo p\u00fablico, y siempre se llama de la misma manera, por lo que podemos acceder a \u00e9l en cualquier sitio web, simplemente, a\u00f1adiendo robots.txt detr\u00e1s de la direcci\u00f3n web: <\/p>\n\n\n\n<p class=\"has-text-align-center\"><a rel=\"noreferrer noopener\" aria-label=\" (abre en una nueva pesta\u00f1a)\" href=\"https:\/\/jonrivas.com\/robots.txt\" target=\"_blank\">https:\/\/jonrivas.com\/robots.txt<\/a><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u00bfPor qu\u00e9 usar un archivo robots.txt? <\/h2>\n\n\n\n<p>Una raz\u00f3n para usar este archivo es evitar que nuestra web se vea desbordada por peticiones de robots y afecte a nuestro tr\u00e1fico. Hay que tener en cuenta que robots como el de Google reservan un tiempo concreto para rastrear nuestra web. A esto se le llama \u00ab<strong>presupuesto de rastreo<\/strong>\u00ab. Este tiempo lo asigna en base a la importancia de nuestra web, su tama\u00f1o, frecuencia de actualizaci\u00f3n&#8230; una vez consumido ese tiempo deja de rastrear nuestra web. Es por eso que no nos conviene que pierda el tiempo con archivos que no nos interesan y los deshabilitarlos por medio del robots. <\/p>\n\n\n\n<p>\n\nMuchas veces se usa para evitar que los buscadores indexen alguna de nuestras p\u00e1ginas, por ejemplo la de <em>cookies<\/em>, aviso legal&#8230; Sin embargo no es la opci\u00f3n m\u00e1s correcta. Las p\u00e1ginas que no queramos que sean indexadas deben de llevar la meta etiqueta <em>noindex<\/em> en su <em>head<\/em>. S\u00ed que se usa, sin embargo, para que no se indexen im\u00e1genes o archivos multimedia. \n\n<\/p>\n\n\n\n<div class=\"row\"><div class=\"col-md-6\">\n\n\n\n<h2 class=\"wp-block-heading\">User-agent<\/h2>\n\n\n\n<p>Dentro del documento podemos declarar reglas generales o reglas para un rastreador concreto. Para ello usaremos la instrucci\u00f3n \u00abUser-agent:\u00bb seguido del nombre de la ara\u00f1a a la que afectar\u00e1 la regla. En caso de que la instrucci\u00f3n vaya dirigida a todos los robots usaremos el asterisco.  <\/p>\n\n\n\n<p>As\u00ed, con la siguiente expresi\u00f3n, indicar\u00edamos que queremos que todo nuestro sitio sea rastreable para todos los robots.  <\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">User-agent: *<br>Allow: \/<\/pre>\n\n\n\n<p>Mientras que esta otra instrucci\u00f3n especificar\u00eda que la carpeta \u00abtmp\u00bb no sea accesible para el robot de Google:  <\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">User-agent:  Googlebot<br>Disallow: \/tmp\/<\/pre>\n\n\n\n<\/div><div class=\"col-md-6\">\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"738\" src=\"https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2020\/01\/robots.txt-que-es-user-agent.jpg\" alt=\"Robots.txt Google User Agent\" class=\"wp-image-259\" srcset=\"https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2020\/01\/robots.txt-que-es-user-agent.jpg 800w, https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2020\/01\/robots.txt-que-es-user-agent-300x277.jpg 300w, https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2020\/01\/robots.txt-que-es-user-agent-768x708.jpg 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/figure>\n<\/div>\n\n\n<\/div><\/div>\n\n\n\n<h3 class=\"wp-block-heading\">Los robots m\u00e1s habituales<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Googlebot: Rastreador de Google<\/li>\n\n\n\n<li>Bingbot: Rastreador de Bing<\/li>\n\n\n\n<li>Slurp: Rastreador de Yahoo<\/li>\n\n\n\n<li>Baiduspider: Rastreador de Baidu (muy popular en China)<\/li>\n\n\n\n<li>Ia_archiver: Rastreador Alexa<\/li>\n\n\n\n<li>YandexBot: Rastreador de Yandex<\/li>\n\n\n\n<li>&#8230;<\/li>\n<\/ul>\n\n\n\n<p>La lista de rastreadores es inmensa, si quieres consultar una lista muy completa puedes hacerlo en <a rel=\"noreferrer noopener\" href=\"http:\/\/www.user-agents.org\/\" target=\"_blank\">User-agents.com<\/a>.  <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Allow \/ Disallow<\/h2>\n\n\n\n<p><em>Allow <\/em>indica al robot qu\u00e9 directorios se pueden rastrear, mientras que <em>Disallow <\/em>indica los que quedar\u00e1n restringidos. Las instruciones las va cumpliendo seg\u00fan va leyendo el archivo, por lo que con en el siguiente c\u00f3digo leer\u00eda todo el directorio \/constructor\/uploads\/ y los archivos de JavaScript de la carpeta \/constructor\/, pero no el resto del contenido:\n\n<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">User-agent: *<br>Allow: \/constructor\/uploads\/*<br>Allow: \/constructor\/*.js<br>Disallow: \/constructor\/<\/pre>\n\n\n\n<h2 class=\"wp-block-heading\">Sitemap<\/h2>\n\n\n\n<p>La<strong> \u00faltima l\u00ednea del robots.txt<\/strong> la reservaremos para incluir <strong>la direcci\u00f3n de nuestro <\/strong><em><strong>sitemap<\/strong><\/em>. Esto es siempre deseable para ayudar a los rastreadores a priorizar y encontrar las p\u00e1ginas que queremos indexar. Esta url debe aparecer completa, incluyendo el protocolo usado.  <\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">Sitemap: https:\/\/www.miwebamedida.com\/sitemap.xml<\/pre>\n\n\n\n<h2 class=\"wp-block-heading\">Comentarios<\/h2>\n\n\n\n<p>Podemos a\u00f1adir comentarios y notas en el documento sin que afecten a su funcionamiento, para ello usamos la <strong>almohadilla <\/strong>y, lo que escribamos a partir de ella, ser\u00e1 ignorado a nivel funcional.  <\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">Disallow: \/comments\/ # Comentario en la misma linea que la instrucci\u00f3n<br>Disallow: \/page\/<br># Comentario en linea independiente<br>Sitemap: https:\/\/www.laminotech.com\/sitemap_index.xml<\/pre>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusi\u00f3n<\/h2>\n\n\n\n<p>Jugando con los elementos que hemos visto ya podemos crear un documento a la medida de nuestra web. Hay que tener en cuenta que cada sitio es diferente y tiene necesidades y preferencias \u00fanicas, por lo que no hay un robots.txt \u00fanico que podamos ofrecerte. Se trata de hacer <strong>un documento a medida<\/strong> eliminando del rastreo las p\u00e1ginas con las que no queremos que las ara\u00f1as pierdan tiempo, quit\u00e1ndonos a nosotros presupuesto de rastreo.<\/p>\n\n\n\n<p>Tambi\u00e9n ten en cuenta que <strong>una mala configuraci\u00f3n de este archivo puede hacer que dejemos, sin querer, alguna p\u00e1gina sin indexar<\/strong>. Es necesario escribirlo con cuidado o descubrir posibles errores realizando una <a href=\"https:\/\/carontestudio.com\/web\/auditoria-web-vitoria\">auditor\u00eda web<\/a>. <\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u00bfSabes lo qu\u00e9 es el robots.txt? \u00bfQuieres aprender a crearlo de una manera sencilla? Caronte Web Studio te explica qu\u00e9 es, c\u00f3mo funciona y por qu\u00e9 usar un archivo robots.txt de manera correcta.<\/p>\n","protected":false},"author":2,"featured_media":476,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[22],"tags":[],"class_list":["post-277","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-seo"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Robots.txt: qu\u00e9 es y c\u00f3mo funciona - Caronte Web Studio<\/title>\n<meta name=\"description\" content=\"\u00bfSabes lo qu\u00e9 es el robots.txt? \u00bfQuieres aprender a crearlo de una manera sencilla? Caronte Web Studio te explica qu\u00e9 es y c\u00f3mo funciona.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/\" \/>\n<meta property=\"og:locale\" content=\"es_ES\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Robots.txt: qu\u00e9 es y c\u00f3mo funciona - Caronte Web Studio\" \/>\n<meta property=\"og:description\" content=\"\u00bfSabes lo qu\u00e9 es el robots.txt? \u00bfQuieres aprender a crearlo de una manera sencilla? Caronte Web Studio te explica qu\u00e9 es y c\u00f3mo funciona.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog de maketing | Caronte\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/carontewebstudio\/\" \/>\n<meta property=\"article:published_time\" content=\"2020-03-31T11:00:21+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-07-15T11:44:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2020\/01\/robots-txt-que-es-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1250\" \/>\n\t<meta property=\"og:image:height\" content=\"737\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Alberto Bravo\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Escrito por\" \/>\n\t<meta name=\"twitter:data1\" content=\"Alberto Bravo\" \/>\n\t<meta name=\"twitter:label2\" content=\"Tiempo de lectura\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutos\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/\"},\"author\":{\"name\":\"Alberto Bravo\",\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/#\\\/schema\\\/person\\\/a0133e9cd91f1e8b75d120ac01ff0350\"},\"headline\":\"Robots.txt: qu\u00e9 es y c\u00f3mo funciona\",\"datePublished\":\"2020-03-31T11:00:21+00:00\",\"dateModified\":\"2025-07-15T11:44:08+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/\"},\"wordCount\":677,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/01\\\/robots-txt-que-es-1.jpg\",\"articleSection\":[\"SEO\"],\"inLanguage\":\"es\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/\",\"url\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/\",\"name\":\"Robots.txt: qu\u00e9 es y c\u00f3mo funciona - Caronte Web Studio\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/01\\\/robots-txt-que-es-1.jpg\",\"datePublished\":\"2020-03-31T11:00:21+00:00\",\"dateModified\":\"2025-07-15T11:44:08+00:00\",\"description\":\"\u00bfSabes lo qu\u00e9 es el robots.txt? \u00bfQuieres aprender a crearlo de una manera sencilla? Caronte Web Studio te explica qu\u00e9 es y c\u00f3mo funciona.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/#breadcrumb\"},\"inLanguage\":\"es\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"es\",\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/#primaryimage\",\"url\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/01\\\/robots-txt-que-es-1.jpg\",\"contentUrl\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/wp-content\\\/uploads\\\/2020\\\/01\\\/robots-txt-que-es-1.jpg\",\"width\":1250,\"height\":737,\"caption\":\"Robots.txt: Qu\u00e9 es\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/robots-txt-que-es-como-funciona\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Portada\",\"item\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Robots.txt: qu\u00e9 es y c\u00f3mo funciona\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/\",\"name\":\"Blog de marketing | Caronte\",\"description\":\"En nuestro blog encontrar\u00e1s art\u00edculos semanales sobre SEO, marketing online, programaci\u00f3n web y mucho m\u00e1s.\",\"publisher\":{\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"es\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/#organization\",\"name\":\"Caronte - Agencia de marketing\",\"url\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"es\",\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/caronte-agencia-de-marketing-logo.png\",\"contentUrl\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/caronte-agencia-de-marketing-logo.png\",\"width\":1090,\"height\":155,\"caption\":\"Caronte - Agencia de marketing\"},\"image\":{\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/carontewebstudio\\\/\",\"https:\\\/\\\/www.instagram.com\\\/caronte_studio\\\/\",\"https:\\\/\\\/www.tiktok.com\\\/@carontewebstudio\",\"https:\\\/\\\/www.youtube.com\\\/@carontewebstudio\",\"https:\\\/\\\/es.linkedin.com\\\/company\\\/carontewebstudio\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/#\\\/schema\\\/person\\\/a0133e9cd91f1e8b75d120ac01ff0350\",\"name\":\"Alberto Bravo\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"es\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/459c471b2404a0ce253ecf5bfdb8d313ed5973d63d20347d265e48a5429e6a7d?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/459c471b2404a0ce253ecf5bfdb8d313ed5973d63d20347d265e48a5429e6a7d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/459c471b2404a0ce253ecf5bfdb8d313ed5973d63d20347d265e48a5429e6a7d?s=96&d=mm&r=g\",\"caption\":\"Alberto Bravo\"},\"sameAs\":[\"http:\\\/\\\/albertobravoart.com\",\"https:\\\/\\\/www.instagram.com\\\/albertobravoart\\\/\",\"https:\\\/\\\/es.linkedin.com\\\/in\\\/albertobravobarreiro\",\"https:\\\/\\\/www.youtube.com\\\/@albertobravoart224\"],\"url\":\"https:\\\/\\\/carontestudio.com\\\/blog\\\/author\\\/alberto\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Robots.txt: qu\u00e9 es y c\u00f3mo funciona - Caronte Web Studio","description":"\u00bfSabes lo qu\u00e9 es el robots.txt? \u00bfQuieres aprender a crearlo de una manera sencilla? Caronte Web Studio te explica qu\u00e9 es y c\u00f3mo funciona.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/","og_locale":"es_ES","og_type":"article","og_title":"Robots.txt: qu\u00e9 es y c\u00f3mo funciona - Caronte Web Studio","og_description":"\u00bfSabes lo qu\u00e9 es el robots.txt? \u00bfQuieres aprender a crearlo de una manera sencilla? Caronte Web Studio te explica qu\u00e9 es y c\u00f3mo funciona.","og_url":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/","og_site_name":"Blog de maketing | Caronte","article_publisher":"https:\/\/www.facebook.com\/carontewebstudio\/","article_published_time":"2020-03-31T11:00:21+00:00","article_modified_time":"2025-07-15T11:44:08+00:00","og_image":[{"width":1250,"height":737,"url":"https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2020\/01\/robots-txt-que-es-1.jpg","type":"image\/jpeg"}],"author":"Alberto Bravo","twitter_card":"summary_large_image","twitter_misc":{"Escrito por":"Alberto Bravo","Tiempo de lectura":"4 minutos"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/#article","isPartOf":{"@id":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/"},"author":{"name":"Alberto Bravo","@id":"https:\/\/carontestudio.com\/blog\/#\/schema\/person\/a0133e9cd91f1e8b75d120ac01ff0350"},"headline":"Robots.txt: qu\u00e9 es y c\u00f3mo funciona","datePublished":"2020-03-31T11:00:21+00:00","dateModified":"2025-07-15T11:44:08+00:00","mainEntityOfPage":{"@id":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/"},"wordCount":677,"commentCount":0,"publisher":{"@id":"https:\/\/carontestudio.com\/blog\/#organization"},"image":{"@id":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/#primaryimage"},"thumbnailUrl":"https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2020\/01\/robots-txt-que-es-1.jpg","articleSection":["SEO"],"inLanguage":"es","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/","url":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/","name":"Robots.txt: qu\u00e9 es y c\u00f3mo funciona - Caronte Web Studio","isPartOf":{"@id":"https:\/\/carontestudio.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/#primaryimage"},"image":{"@id":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/#primaryimage"},"thumbnailUrl":"https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2020\/01\/robots-txt-que-es-1.jpg","datePublished":"2020-03-31T11:00:21+00:00","dateModified":"2025-07-15T11:44:08+00:00","description":"\u00bfSabes lo qu\u00e9 es el robots.txt? \u00bfQuieres aprender a crearlo de una manera sencilla? Caronte Web Studio te explica qu\u00e9 es y c\u00f3mo funciona.","breadcrumb":{"@id":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/#breadcrumb"},"inLanguage":"es","potentialAction":[{"@type":"ReadAction","target":["https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/"]}]},{"@type":"ImageObject","inLanguage":"es","@id":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/#primaryimage","url":"https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2020\/01\/robots-txt-que-es-1.jpg","contentUrl":"https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2020\/01\/robots-txt-que-es-1.jpg","width":1250,"height":737,"caption":"Robots.txt: Qu\u00e9 es"},{"@type":"BreadcrumbList","@id":"https:\/\/carontestudio.com\/blog\/robots-txt-que-es-como-funciona\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Portada","item":"https:\/\/carontestudio.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Robots.txt: qu\u00e9 es y c\u00f3mo funciona"}]},{"@type":"WebSite","@id":"https:\/\/carontestudio.com\/blog\/#website","url":"https:\/\/carontestudio.com\/blog\/","name":"Blog de marketing | Caronte","description":"En nuestro blog encontrar\u00e1s art\u00edculos semanales sobre SEO, marketing online, programaci\u00f3n web y mucho m\u00e1s.","publisher":{"@id":"https:\/\/carontestudio.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/carontestudio.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"es"},{"@type":"Organization","@id":"https:\/\/carontestudio.com\/blog\/#organization","name":"Caronte - Agencia de marketing","url":"https:\/\/carontestudio.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"es","@id":"https:\/\/carontestudio.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2025\/06\/caronte-agencia-de-marketing-logo.png","contentUrl":"https:\/\/carontestudio.com\/blog\/wp-content\/uploads\/2025\/06\/caronte-agencia-de-marketing-logo.png","width":1090,"height":155,"caption":"Caronte - Agencia de marketing"},"image":{"@id":"https:\/\/carontestudio.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/carontewebstudio\/","https:\/\/www.instagram.com\/caronte_studio\/","https:\/\/www.tiktok.com\/@carontewebstudio","https:\/\/www.youtube.com\/@carontewebstudio","https:\/\/es.linkedin.com\/company\/carontewebstudio"]},{"@type":"Person","@id":"https:\/\/carontestudio.com\/blog\/#\/schema\/person\/a0133e9cd91f1e8b75d120ac01ff0350","name":"Alberto Bravo","image":{"@type":"ImageObject","inLanguage":"es","@id":"https:\/\/secure.gravatar.com\/avatar\/459c471b2404a0ce253ecf5bfdb8d313ed5973d63d20347d265e48a5429e6a7d?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/459c471b2404a0ce253ecf5bfdb8d313ed5973d63d20347d265e48a5429e6a7d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/459c471b2404a0ce253ecf5bfdb8d313ed5973d63d20347d265e48a5429e6a7d?s=96&d=mm&r=g","caption":"Alberto Bravo"},"sameAs":["http:\/\/albertobravoart.com","https:\/\/www.instagram.com\/albertobravoart\/","https:\/\/es.linkedin.com\/in\/albertobravobarreiro","https:\/\/www.youtube.com\/@albertobravoart224"],"url":"https:\/\/carontestudio.com\/blog\/author\/alberto\/"}]}},"_links":{"self":[{"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/posts\/277","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/comments?post=277"}],"version-history":[{"count":9,"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/posts\/277\/revisions"}],"predecessor-version":[{"id":23986,"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/posts\/277\/revisions\/23986"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/media\/476"}],"wp:attachment":[{"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/media?parent=277"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/categories?post=277"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/carontestudio.com\/blog\/wp-json\/wp\/v2\/tags?post=277"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}