Skip to main content
Solved

Bulk URL Lookups

  • April 10, 2024
  • 5 replies
  • 545 views

Forum|alt.badge.img+5

Hi, has anyone found a way to do bulk URL lookups? I have 100’s of URLs that I want to find their associated categories of. I’ve tried using Advanced Analytics, but it seems unreliable to give me the pre-defined Netskope categories that I’m searching for. 

Best answer by Fazil

@xstuartbarrettx 

We haven't developed an endpoint yet to accommodate bulk URL lookup for Netskope customers. A feature flag was submitted some time ago and is currently under review by the PM. Tentatively, we aim to have this feature online by Q2 2024.

Regards,
Fazil
Sr Cloud Security Engineer @Netskope

This topic has been closed for replies.

5 replies

qyost
Forum|alt.badge.img+16
  • Explorer III
  • 146 replies
  • April 10, 2024

Check the APIv2 docs.   There is an endpoint for bulk lookup. 


Forum|alt.badge.img+5
  • Author
  • New Member III
  • 5 replies
  • April 10, 2024

Ahh, used to using the ones with the convenient examples near the top.

I found it, but don’t know the actual Endpoint URL. Can anyone enlighten me on it?

bulk-lookup-request{

query {
urls [
example: List [ "https://www.netskope.com", "https://www.google.com", "https://www.airbnb.com" ]

user queried URLs

string($url)]
}

}


Forum|alt.badge.img+5
  • Author
  • New Member III
  • 5 replies
  • April 12, 2024

Anyone?


  • Netskope Employee
  • 16 replies
  • Answer
  • April 30, 2024

@xstuartbarrettx 

We haven't developed an endpoint yet to accommodate bulk URL lookup for Netskope customers. A feature flag was submitted some time ago and is currently under review by the PM. Tentatively, we aim to have this feature online by Q2 2024.

Regards,
Fazil
Sr Cloud Security Engineer @Netskope


Forum|alt.badge.img+6
  • Netskope Employee
  • 1 reply
  • April 4, 2025

This has been made available since version 119.0.0 and you can find it also in the Swagger doc:

curl -X "POST" "https://<yourtenant>.goskope.com/api/v2/nsiq/urllookup" \
-H 'Authorization: Bearer <yourtoken>' \
-H 'Content-Type: application/json' \
-d $'{
"query": {
"disable_dns_lookup": true,
"category": "swg",
"urls": [
"https://www.netskope.com",
"https://www.google.com",
"https://www.airbnb.com"
]
}
}'

 

{
"query": {
"urls": [
"https://www.netskope.com",
"https://www.google.com",
"https://www.airbnb.com"
],
"disable_dns_lookup": true,
"category": "swg"
},
"result": [
{
"url": "https://www.airbnb.com",
"categories": [
{
"id": "10001",
"name": "All Categories",
"type": "custom"
},
{
"id": "572",
"name": "Travel",
"type": "predefined"
}
],
"url_lists": [],
"dynamic_classification": false,
"site": "Airbnb",
"app": ""
},
{
"url": "https://www.google.com",
"categories": [
{
"id": "10001",
"name": "All Categories",
"type": "custom"
},
{
"id": "551",
"name": "Search Engines",
"type": "predefined"
}
],
"url_lists": [],
"dynamic_classification": false,
"site": "google",
"app": ""
},
{
"url": "https://www.netskope.com",
"categories": [
{
"id": "10001",
"name": "All Categories",
"type": "custom"
},
{
"id": "26",
"name": "Security",
"type": "predefined"
}
],
"url_lists": [],
"dynamic_classification": false,
"site": "netskope",
"app": ""
}
]
}