{"id":284,"date":"2018-04-19T08:50:51","date_gmt":"2018-04-19T14:20:51","guid":{"rendered":"https:\/\/www.propellum.com\/blog\/?p=284"},"modified":"2018-09-06T01:10:31","modified_gmt":"2018-09-06T06:40:31","slug":"what-do-job-crawlers-do","status":"publish","type":"post","link":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/","title":{"rendered":"What do job crawlers do? (Spoiler alert: Job Crawling makes your life easier)"},"content":{"rendered":"<p>Web crawling shares a long history of evolution and application with various business segments. A lot of businesses, in fact, have their foundation ingrained in crawling, which involves the systematic browsing of a vast database to look for information that\u2019s relevant to the purpose of the search. The most well-known and popular example of crawling is the web crawlers that visit the umpteen web pages and acquire data, which in turn is used by web search engines to update their content. But not all crawlers are meant for the web. Since a crawler, in essence, is nothing but a program that automates the search and indexing of data, they can be put to a lot of different and unique applications; job crawling being one of them.<\/p>\n<p>&nbsp;<\/p>\n<h2><span style=\"color: #00ccff;\">So, what do job crawlers do?<\/span><\/h2>\n<p><a href=\"https:\/\/www.propellum.com\/job-crawling-service.html\">Job crawlers<\/a> unleash the potential of the age-old crawling techniques in the recruitment parlance to translate the power of this technology in finding the most niche, latest, and relevant job feeds for job portals. If you\u2019re a job board and would like to become the most sought after portal for employer and career sites to post their job openings and for candidates to hunt jobs, you need to support:<\/p>\n<ul>\n<li>Accurate job postings<\/li>\n<li>Multilingual job wrapping<\/li>\n<li>Global coverage of job postings<\/li>\n<li>24&#215;7 import of all kinds of job feeds<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h2><span style=\"color: #00ccff;\">But to have any or all of these, you first need to have a job crawler in place.<\/span><\/h2>\n<p>\u201cSo, does that mean that without job crawling there is no way I can run a job board?\u201d The answer is Yes and No. If you wish to have a job board that showcases a limited and mostly outdated set of job postings that just about any other job board could have, you can do without an efficient job crawler. But if you envision your job board to become a cornerstone in the field of talent acquisition and recruitment, you can\u2019t proceed without setting this significant process in place. Job crawling leaves no stone unturned by passionately searching for the most exclusive, latest, and premium job feeds from around the world. So if a vacancy exists online, your job crawler will scour all possible online sources to have the job posted on your job portal.\u00a0 And we strongly feel that all job boards must demand that out of their job crawler? because no career or employer site will ever say, \u201cLet\u2019s post our jobs on that job portal that hosts the most outdated and generic job postings so that no candidate should ever care respond to our openings.\u201d<\/p>\n<p>&nbsp;<\/p>\n<h2><span style=\"color: #00ccff;\">Remember, quality job postings beget more quality job postings! <\/span><\/h2>\n<p>It\u2019s quite natural for career and employer sites to gravitate towards job boards that already host exclusive and high-quality postings rather than to those that are overwhelmed with massive job aggregation.<\/p>\n<p>&nbsp;<\/p>\n<p>State-of-the-art, premium job crawlers like Propellum will get your job board connected with the most coveted and top ranked employers and recruiters. Such a crawler will in fact, go an extra mile to offer:<\/p>\n<ul>\n<li>Compatibility with any and every job source that can be hosted online, such as online blogs, online doc files, FTP hosted files, etc.<\/li>\n<li>Seamless integration with a job board\u2019s existing IT infrastructure<\/li>\n<li>Navigation through varying job formats, spacing, and structures created by different employer and career sites<\/li>\n<li>Access to the most lucrative and revenue-generating clients<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h2><span style=\"color: #00ccff;\">The Cake Analogy<\/span><\/h2>\n<figure id=\"attachment_64\" aria-describedby=\"caption-attachment-64\" style=\"width: 300px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-64\" src=\"https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/03\/cake-300x200.jpg\" alt=\"Job Crawling Cake analogy\" width=\"300\" height=\"200\" srcset=\"https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/03\/cake-300x200.jpg 300w, https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/03\/cake-600x400.jpg 600w, https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/03\/cake-768x512.jpg 768w, https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/03\/cake-1024x682.jpg 1024w, https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/03\/cake-809x539.jpg 809w, https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/03\/cake.jpg 1073w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><figcaption id=\"caption-attachment-64\" class=\"wp-caption-text\">Job Crawling Cake analogy<\/figcaption><\/figure>\n<p>However, no stand-alone job crawler can offer your job portal so much, and if a crawler makes that claim then you\u2019ve got to prepare yourself for incurring additional and probably an escalating cost of implementation. We can say this with a lot of confidence because we\u2019ve spent almost two decades empowering job boards to know that a stand-alone <a href=\"https:\/\/www.propellum.com\/job-crawling-service.html\">job crawling tool<\/a> or technology will not be able to consistently and coherently fit into the end-to-end requirements of a job board. Let\u2019s understand this point with the help of a simple analogy. Imagine you decide to bake a cake for a family dinner. After having mixed half the ingredients, you get an important phone call that you just have to take. So, you ask your spouse to take over, without sharing any details on what\u2019s already been added to the batter. Now, the fate of the cake is pretty indecisive, to say the least. You don\u2019t want to do something so risky with your job portal, right? The idea, therefore, is not just to have a job crawler on board, but also to have the most effective one.<\/p>\n<p>&nbsp;<\/p>\n<p>The (right) job crawlers:<\/p>\n<ul>\n<li>Are customizable and fit all your job aggregation needs<\/li>\n<li>Are scalable and allow you to grow your client-base with worry-free data quality<\/li>\n<li>Increase job liquidity<\/li>\n<li>Offer unlimited job source selection<\/li>\n<li>Completely automate the process of job sourcing<\/li>\n<li>Avoid sending traffic to other job aggregators<\/li>\n<li>Avoid spam by fetching jobs from original sources<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h2><span style=\"color: #00ccff;\">Wondering how job boards can start using job crawling?<\/span><\/h2>\n<p>&nbsp;<\/p>\n<p>Now that enough has been discussed about the wonders of leveraging a job crawler in your job portal business, the next question is &#8211; how? How do I use the <a href=\"https:\/\/www.propellum.com\/job-crawling-service.html\">job crawling technology<\/a> in my business? So, there are three things you could do:<\/p>\n<p>&nbsp;<\/p>\n<ol>\n<li>develop an in-house team of experts who can who can make use of some open-source technologies and build upon them to crawl through career sites and hunt for job feeds,<\/li>\n<\/ol>\n<ol>\n<li>buy some \u2018DIY\u2019 tool and ask a dedicated team to use it for quicker access to job feeds, while facing lesser technical barriers than with the approach above,<\/li>\n<li>outsource all your job crawling needs to an external provider.<\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<p>But before you make a choice, understand the implications of your choice well. The first approach will demand a dedicated team that can take care of the end-to-end monitoring of the crawl pipeline. Scalability can be a big issue here, as the number of career sites you target keep growing. The in-house team will have to spend innumerable hours and resources to obtain the latest job feeds, leaving them with little to no time to focus on the job board\u2019s core function that crawls were only meant to supplement.<\/p>\n<p>&nbsp;<\/p>\n<p>The second approach, on the other hand, saves time and resources but suffers from its own set of challenges, scalability, and customization being the biggest. Besides, in case of any technical glitch or failure, such off-the-shelf crawling tools offer very limited control on the fixes.<\/p>\n<p>&nbsp;<\/p>\n<h2><span style=\"color: #00ccff;\">Allow <\/span>Propellum<span style=\"color: #00ccff;\"> to introduce you to the \u2018real\u2019 power of job crawling<\/span><\/h2>\n<p>Outsourcing your job crawling needs to an external provider brings you clean, structured, and continuous job feeds; no matter how many career sites you wish to target and how varying and complex their page structures are. Since Propellum is a <a href=\"https:\/\/www.propellum.com\/about-us.html\">leader in the space of job crawling and aggregation<\/a>, it utilizes rock-solid technology that\u2019s backed by super efficient customer service and a team of domain experts. Besides, it truly helps that we offer a holistic recruitment solution, targeted especially for job boards, that covers:<\/p>\n<p>&nbsp;<\/p>\n<ul>\n<li>Job crawling<\/li>\n<li>Job aggregation<\/li>\n<li>Job wrapping<\/li>\n<li>Job posting automation<\/li>\n<li>Job feed categorization<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p>And while our offerings are multiple, the process we follow remains simple and streamlined for our client\u2019s understanding:<\/p>\n<p>We find out client requirements -&gt; Seamlessly integrate the requirements in our software to crawl and find the most relevant job feeds -&gt; Make the job postings go live on your job board platform.<\/p>\n<p>Propellum\u2019s SaaS based recruitment solutions have been built to incorporate all client requirements while enabling accelerated and accurate onboarding of jobs directly from employer and career sites to job boards and professional networking sites. So if you wish to experience the power of recruitment technology that offers your job board advantages like the ones listed below, choose Propellum:<\/p>\n<p>&nbsp;<\/p>\n<ul>\n<li>Quick turnaround time<\/li>\n<li>High scalability<\/li>\n<li>Niche customer focus<\/li>\n<li>End-to-end job posting solution<\/li>\n<\/ul>\n<p>If you\u2019re a job board that hasn\u2019t considered job crawling as a key differentiator in the field of competitive recruitment, you need to do it now! And what better way to do it than with Propellum.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Web crawling shares a long history of evolution and application [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":42,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22],"tags":[63,65,19,64,66,67],"class_list":["post-284","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-job-crawling","tag-accurate-job-postings","tag-global-coverage-of-job-postings","tag-job-crawling","tag-multilingual-job-wrapping","tag-web-crawling","tag-web-scrapping"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>What do job crawlers do?<\/title>\n<meta name=\"description\" content=\"Since Propellum is a leader in the space of job crawling and aggregation, it utilizes rock-solid technology that\u2019s backed by super efficient customer service and a team of domain experts.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What do job crawlers do?\" \/>\n<meta property=\"og:description\" content=\"Since Propellum is a leader in the space of job crawling and aggregation, it utilizes rock-solid technology that\u2019s backed by super efficient customer service and a team of domain experts.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/\" \/>\n<meta property=\"og:site_name\" content=\"Propellum Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Propellum.Info\/\" \/>\n<meta property=\"article:published_time\" content=\"2018-04-19T14:20:51+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-09-06T06:40:31+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/02\/propellum-blog-img.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"819\" \/>\n\t<meta property=\"og:image:height\" content=\"477\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Propellum Infotech\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@PropellumInfo\" \/>\n<meta name=\"twitter:site\" content=\"@PropellumInfo\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Propellum Infotech\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/\"},\"author\":{\"name\":\"Propellum Infotech\",\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/#\\\/schema\\\/person\\\/57284667f6322fabecd16a5d591f66df\"},\"headline\":\"What do job crawlers do? (Spoiler alert: Job Crawling makes your life easier)\",\"datePublished\":\"2018-04-19T14:20:51+00:00\",\"dateModified\":\"2018-09-06T06:40:31+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/\"},\"wordCount\":1381,\"commentCount\":13848,\"publisher\":{\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/02\\\/propellum-blog-img.jpg\",\"keywords\":[\"Accurate job postings\",\"Global coverage of job postings\",\"job crawling\",\"Multilingual job wrapping\",\"Web crawling\",\"web scrapping\"],\"articleSection\":[\"Job Crawling\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/\",\"url\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/\",\"name\":\"What do job crawlers do?\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/02\\\/propellum-blog-img.jpg\",\"datePublished\":\"2018-04-19T14:20:51+00:00\",\"dateModified\":\"2018-09-06T06:40:31+00:00\",\"description\":\"Since Propellum is a leader in the space of job crawling and aggregation, it utilizes rock-solid technology that\u2019s backed by super efficient customer service and a team of domain experts.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/02\\\/propellum-blog-img.jpg\",\"contentUrl\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/wp-content\\\/uploads\\\/2018\\\/02\\\/propellum-blog-img.jpg\",\"width\":819,\"height\":477,\"caption\":\"Propellum blog\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/what-do-job-crawlers-do\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Blog\",\"item\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Job Crawling\",\"item\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/category\\\/job-crawling\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"What do job crawlers do? (Spoiler alert: Job Crawling makes your life easier)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/\",\"name\":\"Propellum Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/#organization\",\"name\":\"Propellum InfoTech\",\"url\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/06\\\/propellum-tiny-logo.png\",\"contentUrl\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/wp-content\\\/uploads\\\/2019\\\/06\\\/propellum-tiny-logo.png\",\"width\":50,\"height\":50,\"caption\":\"Propellum InfoTech\"},\"image\":{\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/Propellum.Info\\\/\",\"https:\\\/\\\/x.com\\\/PropellumInfo\",\"https:\\\/\\\/in.linkedin.com\\\/company\\\/propellum-com\",\"https:\\\/\\\/in.pinterest.com\\\/Propellum\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.propellum.com\\\/blog\\\/#\\\/schema\\\/person\\\/57284667f6322fabecd16a5d591f66df\",\"name\":\"Propellum Infotech\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/14c428a04d5b03a7e2a0f47eb9382707525e035ad2bf756767f90eeb59dda231?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/14c428a04d5b03a7e2a0f47eb9382707525e035ad2bf756767f90eeb59dda231?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/14c428a04d5b03a7e2a0f47eb9382707525e035ad2bf756767f90eeb59dda231?s=96&d=mm&r=g\",\"caption\":\"Propellum Infotech\"},\"sameAs\":[\"https:\\\/\\\/propellum.com\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What do job crawlers do?","description":"Since Propellum is a leader in the space of job crawling and aggregation, it utilizes rock-solid technology that\u2019s backed by super efficient customer service and a team of domain experts.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/","og_locale":"en_US","og_type":"article","og_title":"What do job crawlers do?","og_description":"Since Propellum is a leader in the space of job crawling and aggregation, it utilizes rock-solid technology that\u2019s backed by super efficient customer service and a team of domain experts.","og_url":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/","og_site_name":"Propellum Blog","article_publisher":"https:\/\/www.facebook.com\/Propellum.Info\/","article_published_time":"2018-04-19T14:20:51+00:00","article_modified_time":"2018-09-06T06:40:31+00:00","og_image":[{"width":819,"height":477,"url":"https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/02\/propellum-blog-img.jpg","type":"image\/jpeg"}],"author":"Propellum Infotech","twitter_card":"summary_large_image","twitter_creator":"@PropellumInfo","twitter_site":"@PropellumInfo","twitter_misc":{"Written by":"Propellum Infotech","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/#article","isPartOf":{"@id":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/"},"author":{"name":"Propellum Infotech","@id":"https:\/\/www.propellum.com\/blog\/#\/schema\/person\/57284667f6322fabecd16a5d591f66df"},"headline":"What do job crawlers do? (Spoiler alert: Job Crawling makes your life easier)","datePublished":"2018-04-19T14:20:51+00:00","dateModified":"2018-09-06T06:40:31+00:00","mainEntityOfPage":{"@id":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/"},"wordCount":1381,"commentCount":13848,"publisher":{"@id":"https:\/\/www.propellum.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/#primaryimage"},"thumbnailUrl":"https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/02\/propellum-blog-img.jpg","keywords":["Accurate job postings","Global coverage of job postings","job crawling","Multilingual job wrapping","Web crawling","web scrapping"],"articleSection":["Job Crawling"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/","url":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/","name":"What do job crawlers do?","isPartOf":{"@id":"https:\/\/www.propellum.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/#primaryimage"},"image":{"@id":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/#primaryimage"},"thumbnailUrl":"https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/02\/propellum-blog-img.jpg","datePublished":"2018-04-19T14:20:51+00:00","dateModified":"2018-09-06T06:40:31+00:00","description":"Since Propellum is a leader in the space of job crawling and aggregation, it utilizes rock-solid technology that\u2019s backed by super efficient customer service and a team of domain experts.","breadcrumb":{"@id":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/#primaryimage","url":"https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/02\/propellum-blog-img.jpg","contentUrl":"https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2018\/02\/propellum-blog-img.jpg","width":819,"height":477,"caption":"Propellum blog"},{"@type":"BreadcrumbList","@id":"https:\/\/www.propellum.com\/blog\/what-do-job-crawlers-do\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog","item":"https:\/\/www.propellum.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Job Crawling","item":"https:\/\/www.propellum.com\/blog\/category\/job-crawling\/"},{"@type":"ListItem","position":3,"name":"What do job crawlers do? (Spoiler alert: Job Crawling makes your life easier)"}]},{"@type":"WebSite","@id":"https:\/\/www.propellum.com\/blog\/#website","url":"https:\/\/www.propellum.com\/blog\/","name":"Propellum Blog","description":"","publisher":{"@id":"https:\/\/www.propellum.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.propellum.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.propellum.com\/blog\/#organization","name":"Propellum InfoTech","url":"https:\/\/www.propellum.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.propellum.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2019\/06\/propellum-tiny-logo.png","contentUrl":"https:\/\/www.propellum.com\/blog\/wp-content\/uploads\/2019\/06\/propellum-tiny-logo.png","width":50,"height":50,"caption":"Propellum InfoTech"},"image":{"@id":"https:\/\/www.propellum.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Propellum.Info\/","https:\/\/x.com\/PropellumInfo","https:\/\/in.linkedin.com\/company\/propellum-com","https:\/\/in.pinterest.com\/Propellum\/"]},{"@type":"Person","@id":"https:\/\/www.propellum.com\/blog\/#\/schema\/person\/57284667f6322fabecd16a5d591f66df","name":"Propellum Infotech","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/14c428a04d5b03a7e2a0f47eb9382707525e035ad2bf756767f90eeb59dda231?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/14c428a04d5b03a7e2a0f47eb9382707525e035ad2bf756767f90eeb59dda231?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/14c428a04d5b03a7e2a0f47eb9382707525e035ad2bf756767f90eeb59dda231?s=96&d=mm&r=g","caption":"Propellum Infotech"},"sameAs":["https:\/\/propellum.com"]}]}},"_links":{"self":[{"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/posts\/284","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/comments?post=284"}],"version-history":[{"count":10,"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/posts\/284\/revisions"}],"predecessor-version":[{"id":393,"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/posts\/284\/revisions\/393"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/media\/42"}],"wp:attachment":[{"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/media?parent=284"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/categories?post=284"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.propellum.com\/blog\/wp-json\/wp\/v2\/tags?post=284"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}