Extract structured forum data at scale in just a click
Get access to clean and relevant forum data at scale, in real-time with optimal quality. Focus on analyzing, not on data preparation and harmonization. Through the use of deep learning, computer vision, and our proxy network, forum data extraction API can help extract data from forums without the need for you to develop and maintain code.
How to use the Zyte forum scraper?
With an AI-enabled automatic extraction API, that is resilient to website/webpage changes, forum data is turned into insight-ready schemas applicable to use cases such as sentiment analysis, Voice of Customer (VoC), Voice of Employee (VoE), and more.
All you have to do is provide a feed of page URLs you want to extract data from into Automatic Extraction API as an API Request, lay back, and let the API do its magic! You'll have structured, machine-readable Forum data directly into your environment in JSON.
Zyte Automatic Extraction supports a comprehensive list of metadata types and with the output delivered directly to your AWS S3 bucket ensuring flexibility to evolve with your needs.
What forum data can be extracted using forum API?
- Topic
- Text
- Date Published
- Upvote count
- Reply count
Forum data extraction output example
[
{
"forumPosts": {
"url": "https://example.com/forum-topic-1",
"topic": {
"name": "Which is the best country to work in?"
},
"posts": [
{
"text": "Finland is often considered the best for it.",
"datePublished": "2020-01-30T00:00:00",
"datePublishedRaw": "Jan 30, 2020",
"upvoteCount": 12,
"replyCount": 1,
"probability": 0.95
},
{
"text": "Switzerland has good work life balance.",
"upvoteCount": 2,
"probability": 0.80
},
{
"text": "Depends on the person",
"replyCount": 1,
"probability": 0.80
}
]
},
"webPage": {
"inLanguages": [
{"code": "en"},
{"code": "es"}
]
},
"query": {
"id": "1564747029122-9e02a1868d70b7a3",
"domain": "example.com",
"userQuery": {
"pageType": "forumPosts",
"url": "https://example.com/forum-topic-1"
}
},
"algorithmVersion": "20.8.1"
}
]
