运行采集器

POST

/v1/scrapers/{scraperId}/run

请求参数

Path 参数

Header 参数

Body 参数application/json

示例

{
    "input": {
        "key": "value",
        "proxyConfig": {
            "proxyType": "RESIDENTIAL",
            "countryCode": "CN"
        }
    },
    "runOptions": {
        "buildTag": "latest",
        "timeoutSecs": 300,
        "memoryMbytes": 1024
    }
}

请求示例代码

Shell

JavaScript

Java

Swift

PHP

Python

HTTP

Objective-C

Ruby

OCaml

Dart

curl --location --request POST '/v1/scrapers//run' \
--header 'beeize-api-token: xxxxxxx' \
--header 'Content-Type: application/json' \
--data-raw '{
    "input": {
        "key": "value",
        "proxyConfig": {
            "proxyType": "RESIDENTIAL",
            "countryCode": "CN"
        }
    },
    "runOptions": {
        "buildTag": "latest",
        "timeoutSecs": 300,
        "memoryMbytes": 1024
    }
}'

返回响应

🟢200成功

application/json

Body

示例

{
    "code": 0,
    "msg": "",
    "data": {
        "id": "zx6ue1uo13g7uhzvj",
        "createAt": "2024-09-04 16:38:58",
        "updateAt": "2024-09-04 16:38:58",
        "deleteFlag": false,
        "scraperId": "mm5733d6hznnyyefr",
        "serviceId": "yv55vjm2zjvsaphlr",
        "status": "CREATED",
        "input": {
            "urls": ["https://www.baidu.com/"],
            "white_list":["/news"],
            "black_list":["/news"], 
            "level": 2, 
            "max_page": 100, 
            "proxyConfig": {
                "proxyType": "NO_PROXY",
                "countryCode": "",
                "ownProxyUrls": []
            }
        },
        "proxyConfig": {
            "countryCode": "cn",
            "proxyType": "RESIDENTIAL"
        },
        "timeoutSec": 600,
        "buildId": "v068wlhypy9473tyv",
        "buildVersion": "0.0.10",
        "origin": "WEB",
        "memory": 2048,
        "logId": "si6ue1uo13g7udjgr",
        "jobId": "si6ue1uo13g7udjgr",
        "kvStoreId": "e36ue1uo13g7ufjvv",
        "datasetId": "ie6ue1uo13g7uezu2",
        "requestQueueId": "tw6ue1uo13g7ug80h"
    }
}

修改于 2024-09-23 07:00:53

获取运行日志