Local data crawler

The bot checks sources from its servers. A few sites answer servers with a captcha, an empty page or a login wall, so the bot sees no new posts there. The local crawler hands those checks to your own browser: it opens the source the way you would yourself, from your connection, and passes the result to the bot.

What it covers

• RSS and Atom feeds of any site
• YouTube channels
• LiveJournal blogs
• Medium authors
• Coub channels
• Instagram profiles

The crawler serves the sources of every chat you manage in Aximo: your personal chat with the bot and the channels and groups you created or administer.

Other platforms — Telegram, VK, X, Facebook, TikTok and the rest — are always checked by our servers; the crawler does not change anything for them.

How to turn it on

1. Install the Aximo Crawler extension in Chrome (or any Chromium browser: Edge, Brave, Opera, Yandex Browser).
2. Open Local crawler in the bot — the bot sends a button with your personal link.
3. Press the button and open the link in the same browser. You come back to this page, and a green bar confirms that the extension is connected. The page can be closed.

From then on the extension works in the background while the browser is open: once a minute it asks the bot which of your sources are due, downloads them and sends them back.

The extension window

Click the extension's icon to see the account it is connected to, the time of the last check and the counters: tasks, fetched, failed, sent and traffic. Below are the latest events.

• Check now — ask for tasks right away instead of waiting for the next minute.
• Pause / Resume — stop and restart the work without disconnecting.
• Disconnect — forget the link; everything the extension stored is erased.

Every log line shows a source and what happened to it: "updated" or the reason it failed, for example "the site blocked access from your browser (HTTP 403)". The code in brackets helps when you write to support.

The link can also be pasted into the window by hand.

Good to know

• The crawler does not make checks more frequent: sources are still checked on your plan's schedule. When a check comes, the bot takes what your browser fetched during the last 5 minutes instead of going to the site itself. For faster checks see Fast check.
• The extension downloads only the addresses of your own sources and sends them only to the bot. It does not read or change the pages you browse.
• The site sees your IP address. In theory it can limit it the way it limits ours; pause the extension and the limit lifts by itself.
• The bot keeps what your browser sent for 5 minutes and stores nothing after that.