{"id":881,"date":"2015-10-21T10:50:26","date_gmt":"2015-10-21T10:50:26","guid":{"rendered":"http:\/\/www.seoreviewtools.com\/?p=881"},"modified":"2017-07-26T09:06:02","modified_gmt":"2017-07-26T09:06:02","slug":"seo-list-crawler","status":"publish","type":"post","link":"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/","title":{"rendered":"SEO List Crawler"},"content":{"rendered":"<blockquote>\n<p class=\"selectionShareable\">Because the API for this tool is no longer reliable the development for this tool is on hold..<\/p>\n<\/blockquote>\n<h2>On-Page SEO Audit<\/h2>\n<p>Use the SEO List Crawler to quickly perform a SEO check on a list of URLs. You can enter up to a whopping <strong>1000 URLs<\/strong> at a time with a daily limit of <strong>2000 URLs<\/strong>. After submitting your list the tool will automatically extract important On-Page SEO elements. The returned results can be used to perform a technical SEO audit or generate a SEO report by using the Excel export function.<\/p>\n<h2>SEO elements this tool will check:<\/h2>\n<ul class=\"explanation\">\n<li>Status code<\/li>\n<li>Destination URL (redirect)<\/li>\n<li>Page Title \/ Title tag content\n<ul>\n<li>Page Title length<\/li>\n<\/ul>\n<\/li>\n<li>Meta description content\n<ul>\n<li>Meta description length<\/li>\n<\/ul>\n<\/li>\n<li>H1 heading content\n<ul>\n<li>Number of H1 headings found<\/li>\n<\/ul>\n<\/li>\n<li>Link Count<\/li>\n<li>Canonical URL<\/li>\n<li>Twitter Profile URL<\/li>\n<\/ul>\n<h2>Status code<\/h2>\n<p>It\u2019s important to know if a page \/ URL returns the right status code. Some status codes you can expect when entering an URL:<\/p>\n<ul class=\"explanation\">\n<li><strong>200<\/strong>, The request has succeeded. This is the most common status code and in most cases the preferred status code. Because it means search engine spiders and browsers can view \/ request this page.<\/li>\n<li><strong>404<\/strong>, The server hasn\u2019t found a match for the entered URL and returned a 404 error. Depending on the cause of this problem you need to fix this issue or check if you entered the right URL (without typos).<\/li>\n<li><strong>301 or 302<\/strong>, These status codes are used to redirect visitors and spiders from URL 1 to URL 2. Redirects can be used for multiple purposes including site \/ URL migrations or to solve 404 error pages.<\/li>\n<\/ul>\n<h2>Destination URL (redirect)<\/h2>\n<p>When the spider detects a 301 or 302 status code it will also detect the final destination URL (the URL where visitors and spiders are redirected to). The destination URL is only visible in the Excel export to save some valuable space inside the HTML data table.<\/p>\n<h2>Page Title \/ Title tag<\/h2>\n<p>The SEO List Crawler will first check if the Page Title can be found if this is the case it will extract the content and it will perform a character count to see it stays within the max. visible (55 \u2013 65 character) limit.<\/p>\n<h2>Meta description<\/h2>\n<p>The meta description is extracted to check if a description has been added to the page and to check the character length of the content. To make sure your description is completely visible in the search results limit it to 150 \/ 160 characters.<\/p>\n<h2>H1 heading<\/h2>\n<p>The H1 Heading tag is extracted and displayed when found. The spider will also check how many H1 are found on a single page.<\/p>\n<h2>Link Count<\/h2>\n<p>The link count number represents the total links found on a page (internal + external links). If you need a specified report please use this tool to get more detailed report: <a href=\"http:\/\/www.seoreviewtools.com\/internal-link-analyzer\/\">http:\/\/www.seoreviewtools.com\/internal-link-analyzer\/<\/a><\/p>\n<h2>Canonical URL<\/h2>\n<p>When a canonical tag is found on a page it will be returned in the report and you can see which page should be index by search engines based on the canonical location.<\/p>\n<h2>Twitter Profile URL<\/h2>\n<p>The final metric returned by this tool (when found), is the Twitter Profile URL. This isn\u2019t a On-Page SEO element, but it\u2019s just nice information to have when you are looking for ways to contact the web master or author of an article.<\/p>\n<h2>SEO List Crawler FAQ:<\/h2>\n<ul class=\"explanation\">\n<li>The SEO List Crawler obeys Robots.txt and Meta robot directives.<\/li>\n<li>Crawl up to 1K URLs at a time<\/li>\n<li>Daily URL crawl limit 2K<\/li>\n<\/ul>\n<h2>Tool limitations:<\/h2>\n<ul class=\"explanation\">\n<li>For now it seems like the export function is only working, like it should, in Firefox and Google Chrome.<\/li>\n<li>When nested H1 elements are found the tool will only try to extract them to a certain depth. When this level is exceeded the tool will return a link to the tool specifically build for this purpose, enabling you extract the H1.<\/li>\n<\/ul>\n<h2>External resources<\/h2>\n<ul class=\"explanation\">\n<li>How does Google interpret 302 (temporary) redirects? &#8211; <a href=\"https:\/\/www.seroundtable.com\/google-302-301-permanent-redirect-21045.html\">https:\/\/www.seroundtable.com\/google-302-301-permanent-redirect-21045.html<\/a><\/li>\n<li>What does this status code mean? Check out the complete list <a href=\"https:\/\/en.wikipedia.org\/wiki\/List_of_HTTP_status_codes\">https:\/\/en.wikipedia.org\/wiki\/List_of_HTTP_status_codes<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"Because the API for this tool is no longer reliable the development for this tool is on hold.. On-Page SEO Audit Use the SEO List Crawler to quickly perform a SEO check on a list of URLs. You can enter up to a whopping 1000 URLs at a time with a daily limit of 2000 URLs. After submitting &#8230;..","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[16],"tags":[],"class_list":["post-881","post","type-post","status-publish","format-standard","hentry","category-deprecated"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>SEO List Crawler \/ On-Page SEO Audit - SEO Review Tools<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"SEO List Crawler \/ On-Page SEO Audit - SEO Review Tools\" \/>\n<meta property=\"og:description\" content=\"Because the API for this tool is no longer reliable the development for this tool is on hold.. On-Page SEO Audit Use the SEO List Crawler to quickly perform a SEO check on a list of URLs. You can enter up to a whopping 1000 URLs at a time with a daily limit of 2000 URLs. After submitting .....\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/\" \/>\n<meta property=\"og:site_name\" content=\"SEO Review Tools\" \/>\n<meta property=\"article:published_time\" content=\"2015-10-21T10:50:26+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2017-07-26T09:06:02+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.seoreviewtools.com\/wp-content\/uploads\/seo-review-tools-social-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"646\" \/>\n\t<meta property=\"og:image:height\" content=\"220\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Jasja ter Horst (admin)\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@SEOReviewTools\" \/>\n<meta name=\"twitter:site\" content=\"@SEOReviewTools\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jasja ter Horst (admin)\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/\"},\"author\":{\"name\":\"Jasja ter Horst (admin)\",\"@id\":\"https:\/\/www.seoreviewtools.com\/#\/schema\/person\/39703415fe4bc4ab775e9c3a88e485cb\"},\"headline\":\"SEO List Crawler\",\"datePublished\":\"2015-10-21T10:50:26+00:00\",\"dateModified\":\"2017-07-26T09:06:02+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/\"},\"wordCount\":671,\"commentCount\":9,\"articleSection\":[\"Deprecated\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/\",\"url\":\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/\",\"name\":\"SEO List Crawler \/ On-Page SEO Audit - SEO Review Tools\",\"isPartOf\":{\"@id\":\"https:\/\/www.seoreviewtools.com\/#website\"},\"datePublished\":\"2015-10-21T10:50:26+00:00\",\"dateModified\":\"2017-07-26T09:06:02+00:00\",\"author\":{\"@id\":\"https:\/\/www.seoreviewtools.com\/#\/schema\/person\/39703415fe4bc4ab775e9c3a88e485cb\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.seoreviewtools.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"SEO List Crawler\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.seoreviewtools.com\/#website\",\"url\":\"https:\/\/www.seoreviewtools.com\/\",\"name\":\"SEO Review Tools\",\"description\":\"Making SEO accessible\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.seoreviewtools.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.seoreviewtools.com\/#\/schema\/person\/39703415fe4bc4ab775e9c3a88e485cb\",\"name\":\"Jasja ter Horst (admin)\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.seoreviewtools.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/bb6e62e3720214b4311a1dd8d0927f75e8ecf14da0f7a8f96fc4a3174ac0dd25?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/bb6e62e3720214b4311a1dd8d0927f75e8ecf14da0f7a8f96fc4a3174ac0dd25?s=96&d=blank&r=g\",\"caption\":\"Jasja ter Horst (admin)\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"SEO List Crawler \/ On-Page SEO Audit - SEO Review Tools","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/","og_locale":"en_US","og_type":"article","og_title":"SEO List Crawler \/ On-Page SEO Audit - SEO Review Tools","og_description":"Because the API for this tool is no longer reliable the development for this tool is on hold.. On-Page SEO Audit Use the SEO List Crawler to quickly perform a SEO check on a list of URLs. You can enter up to a whopping 1000 URLs at a time with a daily limit of 2000 URLs. After submitting .....","og_url":"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/","og_site_name":"SEO Review Tools","article_published_time":"2015-10-21T10:50:26+00:00","article_modified_time":"2017-07-26T09:06:02+00:00","og_image":[{"width":646,"height":220,"url":"https:\/\/www.seoreviewtools.com\/wp-content\/uploads\/seo-review-tools-social-1.png","type":"image\/png"}],"author":"Jasja ter Horst (admin)","twitter_card":"summary_large_image","twitter_creator":"@SEOReviewTools","twitter_site":"@SEOReviewTools","twitter_misc":{"Written by":"Jasja ter Horst (admin)","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/#article","isPartOf":{"@id":"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/"},"author":{"name":"Jasja ter Horst (admin)","@id":"https:\/\/www.seoreviewtools.com\/#\/schema\/person\/39703415fe4bc4ab775e9c3a88e485cb"},"headline":"SEO List Crawler","datePublished":"2015-10-21T10:50:26+00:00","dateModified":"2017-07-26T09:06:02+00:00","mainEntityOfPage":{"@id":"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/"},"wordCount":671,"commentCount":9,"articleSection":["Deprecated"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.seoreviewtools.com\/seo-list-crawler\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/","url":"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/","name":"SEO List Crawler \/ On-Page SEO Audit - SEO Review Tools","isPartOf":{"@id":"https:\/\/www.seoreviewtools.com\/#website"},"datePublished":"2015-10-21T10:50:26+00:00","dateModified":"2017-07-26T09:06:02+00:00","author":{"@id":"https:\/\/www.seoreviewtools.com\/#\/schema\/person\/39703415fe4bc4ab775e9c3a88e485cb"},"breadcrumb":{"@id":"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.seoreviewtools.com\/seo-list-crawler\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.seoreviewtools.com\/seo-list-crawler\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.seoreviewtools.com\/"},{"@type":"ListItem","position":2,"name":"SEO List Crawler"}]},{"@type":"WebSite","@id":"https:\/\/www.seoreviewtools.com\/#website","url":"https:\/\/www.seoreviewtools.com\/","name":"SEO Review Tools","description":"Making SEO accessible","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.seoreviewtools.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.seoreviewtools.com\/#\/schema\/person\/39703415fe4bc4ab775e9c3a88e485cb","name":"Jasja ter Horst (admin)","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.seoreviewtools.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/bb6e62e3720214b4311a1dd8d0927f75e8ecf14da0f7a8f96fc4a3174ac0dd25?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/bb6e62e3720214b4311a1dd8d0927f75e8ecf14da0f7a8f96fc4a3174ac0dd25?s=96&d=blank&r=g","caption":"Jasja ter Horst (admin)"}}]}},"views":56515,"_links":{"self":[{"href":"https:\/\/www.seoreviewtools.com\/wp-json\/wp\/v2\/posts\/881","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.seoreviewtools.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.seoreviewtools.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.seoreviewtools.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.seoreviewtools.com\/wp-json\/wp\/v2\/comments?post=881"}],"version-history":[{"count":0,"href":"https:\/\/www.seoreviewtools.com\/wp-json\/wp\/v2\/posts\/881\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.seoreviewtools.com\/wp-json\/wp\/v2\/media?parent=881"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.seoreviewtools.com\/wp-json\/wp\/v2\/categories?post=881"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.seoreviewtools.com\/wp-json\/wp\/v2\/tags?post=881"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}