R令牌中的HTTR POST

如何解决R令牌中的HTTR POST

我想在以下网站上抓取代理商的数据：https://thep.hoaphat.com.vn/distribution-systems

我正在使用以下代码，但收到“令牌不匹配错误”：

httr::POST(
  url = "https://thep.hoaphat.com.vn/ajax/load_agency",body = list(
    type = "web",product_id = "7",province_id = "10",member_type = "1"
  ),encode = "form"
) -> res

dat <- httr::content(res)
str(dat)

我该如何解决？

解决方法

数据请求https://thep.hoaphat.com.vn/ajax/load_agency

做一点逆向工程，我发现请求是从这个JS文件发送的： https://thep.hoaphat.com.vn/assets/js/functions.min.js

看看这个函数：

function loadAjax(t,e,n) {
    var a = {
        beforeSend: function() {},success: function() {}
    };
    $.extend(a,n),$.ajax({
        headers: {
            "X-CSRF-TOKEN": $('meta[name="csrf-token"]').attr("content")
        },type: "POST",url: t,data: e,beforeSend: function() {
            $("#loading_box").css({
                visibility: "visible",opacity: 0
            }).animate({
                opacity: 1
            },200),a.beforeSend()
        },success: function(t) {
            $("#loading_box").animate({
                opacity: 0
            },200,function() {
                $("#loading_box").css("visibility","hidden")
            }),a.success(t)
        },error: function(t) {
            $("#loading_box").animate({
                opacity: 0
            },alert("Có lỗi xảy ra!")
        }
    })
}

您可以看到令牌来自名为 meta 的 csrf-token 标记。现在您可以抓取该令牌值并发送请求以获取数据：

library(rvest)
pg <- html_session("https://thep.hoaphat.com.vn/distribution-systems")
token <- read_html(pg) %>%
  html_node(xpath = "//meta[@name='csrf-token']") %>% html_attr("content")
pg <- 
  pg %>% rvest:::request_POST(
    "https://thep.hoaphat.com.vn/ajax/load_agency",config = httr::add_headers(`x-csrf-token` = token),body = list(
      type = "web",product_id = 1,# choose product
      province_id = 50,# choose province
      `member_type[]` = 1,# agency level 1
      `member_type[]` = 2 # agency level 2
    )
  )
data <- httr::content(pg$response)$data

结果：