The news parser component for Instant


With the help of the News Parser component, you can parse news from various sources (currently with Vesti and RIA) and add them to your site. There are several ways to add, automatic, manual and by crown (Scheduler).

Automatic
This is when, when clicked, news is automatically added to the site.
Manual
This is when the news addition form is loaded with the fields already filled in and you can edit it and click Save.
Adding a crown
This is when, from the filters created, the parser scheduler adds content to your site, without your participation.

The parser receives the title, text and one photo. The photo is uploaded to your site with all the presets that are on your site. From the body of the news, we get only the text, all photos or videos are deleted.
Filters
You can create filters to filter the paired news. For example, you create a filter with the text "Moscow" then news related to Moscow is added, or as is currently relevant, you create a filter with the text "Olympics" or "RIO" and get the news of the Olympics.
Categories
When parsing from an external site, we get news categories, the component has a convenient category adjuster where you can specify which news should fall into which categories.

Cache
In order not to load the server, when parsing, the data is stored in the cache, the following downloads occur from the cache. This ensures that the component works quickly.
When the Clear Cache button is clicked, the data is deleted from the cache and the component parses the new data.
Integration with FlowCrawler
With the help of a parser, you can import data that you have parsed using the FlowCrawler program in json format (see video).

evelopment of the parser, order the sources.
The DiDOM library is used



IMPORTANT: Before parsing Vesti and RIA Novosti, read the rules for using the materials of these sites.


Go back
11-01-2023, 16:00