{"id":368,"date":"2022-11-09T10:43:03","date_gmt":"2022-11-09T10:43:03","guid":{"rendered":"http:\/\/webunl.com\/?p=368"},"modified":"2022-11-10T11:48:02","modified_gmt":"2022-11-10T11:48:02","slug":"what-is-website-crawling-and-indexing","status":"publish","type":"post","link":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/","title":{"rendered":"Wat is website crawlen en indexeren"},"content":{"rendered":"<p>In this article:<\/p>\n<ul>\n<li>What\u2019s an online crawler?<\/li>\n<li>What&#8217;s crawling?<\/li>\n<li>What&#8217;s crawl budget?<\/li>\n<li>What&#8217;s indexing?<\/li>\n<li>What&#8217;s rendering?<\/li>\n<\/ul>\n<p>The search engine\u2019s mission is to store the complete web, and that they have the ability to do so quickly and efficiently. The size and scale of the complete web is very large.\u00a0 How many pages are there? Back in 2008, Google hit a milestone of one trillion pages crawled on the web. By 2013, Google was creeping around to thirty trillion pages but four years later, Google recognized over one hundred thirty trillion pages. The speed of growth is staggering, and it&#8217;s no little accomplishment to store these pages.<\/p>\n<p>Understanding however Google crawls and indexes all the websites on the web is crucial to your SEO efforts.<\/p>\n<h2>What is crawling? What\u2019s an online crawler?<\/h2>\n<p>Crawling refers to following and storing the links on a page and continues to seek out and follow links of existing and\u00a0 new pages on a website.<\/p>\n<p>A web crawler is a software package program that follows all the links on a page, resulting in new pages, and continues that method till there&#8217;s no additional new links or pages to crawl.<\/p>\n<p>Web crawlers are known by totally different names: robots, spiders, computer program bots, or simply \u201cbots\u201d for brief. They&#8217;re known as robots because they\u00a0 have an appointed job to do ; travel from link to link, and capture every page\u2019s info. Sadly, If you pictured an actual mechanism with metal plates and arms, that\u2019s not what these robots are. Google\u2019s net crawler is known as Google bot.<\/p>\n<p>The process of creeping\u00a0 has to begin somewhere. Google uses associate initial \u201cseed list\u201d of known websites that tend to link to several different sites. They additionally use lists of sites they\u2019ve visited in past crawls in addition to sitemaps submitted by website owner.<\/p>\n<p>Crawling the web is a continuous method for a query engine. It never very stops. It\u2019s vital for search engines to seek out new pages posted or updates to recent pages. They don\u2019t need to waste time and resources on pages that don&#8217;t seem to be sensible candidates for an search result.<\/p>\n<p>Google prioritizes creeping pages that are:<\/p>\n<ul>\n<li>Common (linked to often)<\/li>\n<li>Top quality<\/li>\n<li>Often updated<\/li>\n<\/ul>\n<p>Websites that publish new, quality content tend to get higher priority.<\/p>\n<h2>What is crawl budget?<\/h2>\n<p>Crawl budget is that the variety of pages or requests that Google can crawl for a web site over a amount of your time. the amount of pages budgeted depends on: size, popularity, quality, updates, and speed of the positioning.<\/p>\n<p>If your web site is wasting creeping resources, your crawl budget can diminish quickly, and pages are crawled less often \u2014 leading to lower rankings. A website can accidentally waste web crawler resources by serving up too much low-value URLs to a crawler. This includes \u201cimproper navigation, duplicate content, soft error pages, hacked pages, infinite scroll areas and proxies, quality, and spam content.\u201d<\/p>\n<p>Google identifies websites to crawl\u00a0 based on popularity, however; this doesn&#8217;t ensure a web site to get frequent crawling. A website can opt-out of creeping or limit creeping of components and directives with a robots.txt file. These rules tell computer program net crawlers that components of the web site they&#8217;re allowed to crawl and what they can&#8217;t. Be very careful with robots.txt. It\u2019s simple to accidentally block Google from all pages on a web site.<\/p>\n<pre>Disallow: \/\r\n\r\n[blocks creeping the complete site]\r\n\r\nDisallow: \/login\/\r\n\r\n[blocks creeping each address within the directory \/login\/]<\/pre>\n<p>See Google\u2019s support page for robots.txt if you help making specific and more complex rules.<\/p>\n<p>The robots.txt compel command solely blocks crawling of a page. The link will still be indexed if Google discovers an allow link to the disallowed page. Google will embody the address and anchor text of links to the page in their search results, however it will not have the page\u2019s content.<\/p>\n<p>If you don\u2019t desire a page to be indexed by an indexing program, you will need to add a &#8220;noindex&#8221; tag to the page.<\/p>\n<h2>What is indexing?<\/h2>\n<p>Indexing is storing and organizing the data found on web pages. The software renders the code on the page within the same approach a browser will. It catalogs all the content, links, and data on the page.<\/p>\n<p>Indexing needs a vast quantity of pc resources, and it\u2019s not simply data storage. It takes a colossal quantity of computing resources to render various sites. You&#8217;ll notice this if you open too much browser tabs!<\/p>\n<h2>What is rendering?<\/h2>\n<p>Rendering is decoding the hypertext mark-up language(HTML), CSS, and javascript on the page to create the visual illustration of\u00a0 what you see in your browser. An online browser renders code into a visual representation of a page.<\/p>\n<p>The rendering of hypertext mark-up language code takes process power. If your pages uses javascript to render the page\u2019s content, it takes a large quantity of process power. Search engines will crawl and render javascript pages, the JS rendering can fall within a prioritization queue. If you have a very large website that needs javascript to render the content on the pages, it will take an extended amount of time update the pages&#8217;s index. It\u2019s suggested to serve content and links in hypertext mark-up language instead of javascript, if possible.<\/p>\n<p><strong>Rendering-queue<\/strong><br \/>\nIn this article:<\/p>\n<ul>\n<li>What\u2019s an online crawler?<\/li>\n<li>What&#8217;s crawling?<\/li>\n<li>What&#8217;s crawl budget?<\/li>\n<li>What&#8217;s indexing?<\/li>\n<li>What&#8217;s rendering?<\/li>\n<li>What&#8217;s the distinction between creeping and indexing?<\/li>\n<li>What are you able to do with organized data?<\/li>\n<li>Importance of creeping and classification for your web site, a way to check for creeping and classification problems<\/li>\n<\/ul>\n<p>The search engine\u2019s mission is to store the complete web, and that they have the ability to do so quickly and efficiently. The size and scale of the complete web is very large.\u00a0 How many pages are there? Back in 2008, Google hit a milestone of one trillion pages crawled on the web. By 2013, Google was creeping around to thirty trillion pages but four years later, Google recognized over one hundred thirty trillion pages. The speed of growth is staggering, and it&#8217;s no little accomplishment to store these pages.<\/p>\n<p>Understanding however Google crawls and indexes all the websites on the web is crucial to your SEO efforts.<\/p>\n<h2>What is crawling? What\u2019s an online crawler?<\/h2>\n<p>Crawling refers to following and storing the links on a page and continues to seek out and follow links of existing and\u00a0 new pages on a website.<\/p>\n<p>A web crawler is a software package program that follows all the links on a page, resulting in new pages, and continues that method till there&#8217;s no additional new links or pages to crawl.<\/p>\n<p>Web crawlers are known by totally different names: robots, spiders, computer program bots, or simply \u201cbots\u201d for brief. They&#8217;re known as robots because they\u00a0 have an appointed job to do ; travel from link to link, and capture every page\u2019s info. Sadly, If you pictured an actual mechanism with metal plates and arms, that\u2019s not what these robots are. Google\u2019s net crawler is known as Google bot.<\/p>\n<p>The process of creeping\u00a0 has to begin somewhere. Google uses associate initial \u201cseed list\u201d of known websites that tend to link to several different sites. They additionally use lists of sites they\u2019ve visited in past crawls in addition to sitemaps submitted by website owner.<\/p>\n<p>Crawling the web is a continuous method for a query engine. It never very stops. It\u2019s vital for search engines to seek out new pages posted or updates to recent pages. They don\u2019t need to waste time and resources on pages that don&#8217;t seem to be sensible candidates for an search result.<\/p>\n<p>Google prioritizes creeping pages that are:<\/p>\n<ul>\n<li>Common (linked to often)<\/li>\n<li>Top quality<\/li>\n<li>Often updated<\/li>\n<\/ul>\n<p>Websites that publish new, quality content tend to get higher priority.<\/p>\n<h2>What is crawl budget?<\/h2>\n<p>Crawl budget is that the variety of pages or requests that Google can crawl for a web site over a amount of your time. the amount of pages budgeted depends on: size, popularity, quality, updates, and speed of the positioning.<\/p>\n<p>If your web site is wasting creeping resources, your crawl budget can diminish quickly, and pages are crawled less often \u2014 leading to lower rankings. A website can accidentally waste web crawler resources by serving up too much low-value URLs to a crawler. This includes \u201cimproper navigation, duplicate content, soft error pages, hacked pages, infinite scroll areas and proxies, quality, and spam content.\u201d<\/p>\n<p>Google identifies websites to crawl\u00a0 based on popularity, however; this doesn&#8217;t ensure a web site to get frequent crawling. A website can opt-out of creeping or limit creeping of components and directives with a robots.txt file. These rules tell computer program net crawlers that components of the web site they&#8217;re allowed to crawl and what they can&#8217;t. Be very careful with robots.txt. It\u2019s simple to accidentally block Google from all pages on a web site.<\/p>\n<pre>Disallow: \/\r\n\r\n[blocks creeping the complete site]\r\n\r\nDisallow: \/login\/\r\n\r\n[blocks creeping each address within the directory \/login\/]<\/pre>\n<p>See Google\u2019s support page for robots.txt if you help making specific and more complex rules.<\/p>\n<p>The robots.txt compel command solely blocks crawling of a page. The link will still be indexed if Google discovers an allow link to the disallowed page. Google will embody the address and anchor text of links to the page in their search results, however it will not have the page\u2019s content.<\/p>\n<p>If you don\u2019t desire a page to be indexed by an indexing program, you will need to add a &#8220;noindex&#8221; tag to the page.<\/p>\n<h2>What is indexing?<\/h2>\n<p>Indexing is storing and organizing the data found on web pages. The software renders the code on the page within the same approach a browser will. It catalogs all the content, links, and data on the page.<\/p>\n<p>Indexing needs a vast quantity of pc resources, and it\u2019s not simply data storage. It takes a colossal quantity of computing resources to render various sites. You&#8217;ll notice this if you open too much browser tabs!<\/p>\n<h2>What is rendering?<\/h2>\n<p>Rendering is decoding the hypertext mark-up language(HTML), CSS, and javascript on the page to create the visual illustration of\u00a0 what you see in your browser. An online browser renders code into a visual representation of a page.<\/p>\n<p>The rendering of hypertext mark-up language code takes process power. If your pages uses javascript to render the page\u2019s content, it takes a large quantity of process power. Search engines will crawl and render javascript pages, the JS rendering can fall within a prioritization queue. If you have a very large website that needs javascript to render the content on the pages, it will take an extended amount of time update the pages&#8217;s index. It\u2019s suggested to serve content and links in hypertext mark-up language instead of javascript, if possible.<\/p>\n<p><strong>Rendering-queue<\/strong><\/p>\n<p>Block-level analysis (page segmentation)<\/p>\n<p>Page segmentation or block-level analysis permits a search engine to load the various components of the page: navigation, ads, content, footer, etc. From there, this formula will establish which part of the page contains the foremost vital info or primary content. This helps the computer program perceive what the page is and not get confused by anything around it.<\/p>\n<p>Search engines additionally uses this understanding to penalize low-quality experiences, slow websites, too much ads on a page, or not enough content above-the-fold.<\/p>\n<p>A technical analysis paper printed by Microsoft outlined how different sections on a webpage is understood by the associated formula. Page segmentation is additionally helpful for link analysis.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this article: What\u2019s an online crawler? What&#8217;s crawling? What&#8217;s crawl budget? What&#8217;s indexing? What&#8217;s rendering? The search engine\u2019s mission is to store the complete web, and that they have the ability to do so quickly and efficiently. The size and scale of the complete web is very large.\u00a0 How many pages are there? Back&#8230;<\/p>","protected":false},"author":2,"featured_media":401,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-368","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-general"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>What is website crawling and indexing - webunl<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/\" \/>\n<meta property=\"og:locale\" content=\"nl_NL\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What is website crawling and indexing - webunl\" \/>\n<meta property=\"og:description\" content=\"In this article: What\u2019s an online crawler? What&#8217;s crawling? What&#8217;s crawl budget? What&#8217;s indexing? What&#8217;s rendering? The search engine\u2019s mission is to store the complete web, and that they have the ability to do so quickly and efficiently. The size and scale of the complete web is very large.\u00a0 How many pages are there? Back...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/\" \/>\n<meta property=\"og:site_name\" content=\"webunl\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/webunl\" \/>\n<meta property=\"article:published_time\" content=\"2022-11-09T10:43:03+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-11-10T11:48:02+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/webunl.com\/wp-content\/uploads\/2022\/11\/website-crawling-and-indexing.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"684\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Laura Ann\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@webunl\" \/>\n<meta name=\"twitter:site\" content=\"@webunl\" \/>\n<meta name=\"twitter:label1\" content=\"Geschreven door\" \/>\n\t<meta name=\"twitter:data1\" content=\"Laura Ann\" \/>\n\t<meta name=\"twitter:label2\" content=\"Geschatte leestijd\" \/>\n\t<meta name=\"twitter:data2\" content=\"10 minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/\"},\"author\":{\"name\":\"Laura Ann\",\"@id\":\"https:\\\/\\\/webunl.com\\\/#\\\/schema\\\/person\\\/6c66cc86b9021b4ffc04f77230ec0eba\"},\"headline\":\"What is website crawling and indexing\",\"datePublished\":\"2022-11-09T10:43:03+00:00\",\"dateModified\":\"2022-11-10T11:48:02+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/\"},\"wordCount\":1933,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/webunl.com\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/webunl.com\\\/wp-content\\\/uploads\\\/2022\\\/11\\\/website-crawling-and-indexing.jpg\",\"articleSection\":[\"General\"],\"inLanguage\":\"nl-NL\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/\",\"url\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/\",\"name\":\"What is website crawling and indexing - webunl\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/webunl.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/webunl.com\\\/wp-content\\\/uploads\\\/2022\\\/11\\\/website-crawling-and-indexing.jpg\",\"datePublished\":\"2022-11-09T10:43:03+00:00\",\"dateModified\":\"2022-11-10T11:48:02+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/#breadcrumb\"},\"inLanguage\":\"nl-NL\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"nl-NL\",\"@id\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/#primaryimage\",\"url\":\"https:\\\/\\\/webunl.com\\\/wp-content\\\/uploads\\\/2022\\\/11\\\/website-crawling-and-indexing.jpg\",\"contentUrl\":\"https:\\\/\\\/webunl.com\\\/wp-content\\\/uploads\\\/2022\\\/11\\\/website-crawling-and-indexing.jpg\",\"width\":1024,\"height\":684},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/webunl.com\\\/nl\\\/what-is-website-crawling-and-indexing\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/webunl.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"What is website crawling and indexing\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/webunl.com\\\/#website\",\"url\":\"https:\\\/\\\/webunl.com\\\/\",\"name\":\"webunl\",\"description\":\"Unlimited Web Development\",\"publisher\":{\"@id\":\"https:\\\/\\\/webunl.com\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/webunl.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"nl-NL\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/webunl.com\\\/#organization\",\"name\":\"WEBUNL\",\"url\":\"https:\\\/\\\/webunl.com\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"nl-NL\",\"@id\":\"https:\\\/\\\/webunl.com\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/webunl.com\\\/wp-content\\\/uploads\\\/2022\\\/10\\\/logo-full-transp-ret.png\",\"contentUrl\":\"https:\\\/\\\/webunl.com\\\/wp-content\\\/uploads\\\/2022\\\/10\\\/logo-full-transp-ret.png\",\"width\":400,\"height\":120,\"caption\":\"WEBUNL\"},\"image\":{\"@id\":\"https:\\\/\\\/webunl.com\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/webunl\",\"https:\\\/\\\/x.com\\\/webunl\",\"https:\\\/\\\/www.instagram.com\\\/webunl\",\"https:\\\/\\\/www.youtube.com\\\/webunl\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/webunl.com\\\/#\\\/schema\\\/person\\\/6c66cc86b9021b4ffc04f77230ec0eba\",\"name\":\"Laura Ann\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"nl-NL\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f5dc33187e1fa26bba63ab8686e409be31c4ed8edfbc563cd794995b0e84a055?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f5dc33187e1fa26bba63ab8686e409be31c4ed8edfbc563cd794995b0e84a055?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f5dc33187e1fa26bba63ab8686e409be31c4ed8edfbc563cd794995b0e84a055?s=96&d=mm&r=g\",\"caption\":\"Laura Ann\"},\"description\":\"Laura Ann, head of marketing and SEO strategist.\",\"sameAs\":[\"https:\\\/\\\/webunl.com\"],\"url\":\"https:\\\/\\\/webunl.com\\\/nl\\\/author\\\/laura-ann\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What is website crawling and indexing - webunl","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/","og_locale":"nl_NL","og_type":"article","og_title":"What is website crawling and indexing - webunl","og_description":"In this article: What\u2019s an online crawler? What&#8217;s crawling? What&#8217;s crawl budget? What&#8217;s indexing? What&#8217;s rendering? The search engine\u2019s mission is to store the complete web, and that they have the ability to do so quickly and efficiently. The size and scale of the complete web is very large.\u00a0 How many pages are there? Back...","og_url":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/","og_site_name":"webunl","article_publisher":"https:\/\/www.facebook.com\/webunl","article_published_time":"2022-11-09T10:43:03+00:00","article_modified_time":"2022-11-10T11:48:02+00:00","og_image":[{"width":1024,"height":684,"url":"https:\/\/webunl.com\/wp-content\/uploads\/2022\/11\/website-crawling-and-indexing.jpg","type":"image\/jpeg"}],"author":"Laura Ann","twitter_card":"summary_large_image","twitter_creator":"@webunl","twitter_site":"@webunl","twitter_misc":{"Geschreven door":"Laura Ann","Geschatte leestijd":"10 minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/#article","isPartOf":{"@id":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/"},"author":{"name":"Laura Ann","@id":"https:\/\/webunl.com\/#\/schema\/person\/6c66cc86b9021b4ffc04f77230ec0eba"},"headline":"What is website crawling and indexing","datePublished":"2022-11-09T10:43:03+00:00","dateModified":"2022-11-10T11:48:02+00:00","mainEntityOfPage":{"@id":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/"},"wordCount":1933,"commentCount":0,"publisher":{"@id":"https:\/\/webunl.com\/#organization"},"image":{"@id":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/#primaryimage"},"thumbnailUrl":"https:\/\/webunl.com\/wp-content\/uploads\/2022\/11\/website-crawling-and-indexing.jpg","articleSection":["General"],"inLanguage":"nl-NL","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/","url":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/","name":"What is website crawling and indexing - webunl","isPartOf":{"@id":"https:\/\/webunl.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/#primaryimage"},"image":{"@id":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/#primaryimage"},"thumbnailUrl":"https:\/\/webunl.com\/wp-content\/uploads\/2022\/11\/website-crawling-and-indexing.jpg","datePublished":"2022-11-09T10:43:03+00:00","dateModified":"2022-11-10T11:48:02+00:00","breadcrumb":{"@id":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/#breadcrumb"},"inLanguage":"nl-NL","potentialAction":[{"@type":"ReadAction","target":["https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/"]}]},{"@type":"ImageObject","inLanguage":"nl-NL","@id":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/#primaryimage","url":"https:\/\/webunl.com\/wp-content\/uploads\/2022\/11\/website-crawling-and-indexing.jpg","contentUrl":"https:\/\/webunl.com\/wp-content\/uploads\/2022\/11\/website-crawling-and-indexing.jpg","width":1024,"height":684},{"@type":"BreadcrumbList","@id":"https:\/\/webunl.com\/nl\/what-is-website-crawling-and-indexing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/webunl.com\/"},{"@type":"ListItem","position":2,"name":"What is website crawling and indexing"}]},{"@type":"WebSite","@id":"https:\/\/webunl.com\/#website","url":"https:\/\/webunl.com\/","name":"webunl","description":"Unlimited Web Development","publisher":{"@id":"https:\/\/webunl.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/webunl.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"nl-NL"},{"@type":"Organization","@id":"https:\/\/webunl.com\/#organization","name":"WEBUNL","url":"https:\/\/webunl.com\/","logo":{"@type":"ImageObject","inLanguage":"nl-NL","@id":"https:\/\/webunl.com\/#\/schema\/logo\/image\/","url":"https:\/\/webunl.com\/wp-content\/uploads\/2022\/10\/logo-full-transp-ret.png","contentUrl":"https:\/\/webunl.com\/wp-content\/uploads\/2022\/10\/logo-full-transp-ret.png","width":400,"height":120,"caption":"WEBUNL"},"image":{"@id":"https:\/\/webunl.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/webunl","https:\/\/x.com\/webunl","https:\/\/www.instagram.com\/webunl","https:\/\/www.youtube.com\/webunl"]},{"@type":"Person","@id":"https:\/\/webunl.com\/#\/schema\/person\/6c66cc86b9021b4ffc04f77230ec0eba","name":"Laura Ann","image":{"@type":"ImageObject","inLanguage":"nl-NL","@id":"https:\/\/secure.gravatar.com\/avatar\/f5dc33187e1fa26bba63ab8686e409be31c4ed8edfbc563cd794995b0e84a055?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/f5dc33187e1fa26bba63ab8686e409be31c4ed8edfbc563cd794995b0e84a055?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f5dc33187e1fa26bba63ab8686e409be31c4ed8edfbc563cd794995b0e84a055?s=96&d=mm&r=g","caption":"Laura Ann"},"description":"Laura Ann, head of marketing and SEO strategist.","sameAs":["https:\/\/webunl.com"],"url":"https:\/\/webunl.com\/nl\/author\/laura-ann\/"}]}},"_links":{"self":[{"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/posts\/368","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/comments?post=368"}],"version-history":[{"count":8,"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/posts\/368\/revisions"}],"predecessor-version":[{"id":402,"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/posts\/368\/revisions\/402"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/media\/401"}],"wp:attachment":[{"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/media?parent=368"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/categories?post=368"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/webunl.com\/nl\/wp-json\/wp\/v2\/tags?post=368"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}