MistralAI-Training: a training crawler run by Mistral

MistralAI-Training is a training crawler. It collects pages for this: future Mistral models. Operator: Mistral.

At a glance

Operator
Mistral
robots.txt token
MistralAI-Training
Purpose
Training. Training crawlers collect pages for future models. Keeping them out does not stop the crawlers that fetch pages for answers, which have names of their own.
What it feeds
future Mistral models

What blocking it changes

If you keep MistralAI-Training out, your pages are left out of what it collects for this: future Mistral models. The crawlers that fetch pages for answers have names of their own, so they can still read your site.

User agent

A representative user agent for MistralAI-Training. We use operator documentation where a full string is published. Versions and browser details in real server logs can differ.

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MistralAI-Training/1.0; +https://docs.mistral.ai/robots)

robots.txt lines for MistralAI-Training

robots.txt is a plain text file at the root of a site (yoursite.com/robots.txt). A group starts with one or more User-agent lines that name crawlers, followed by Allow and Disallow lines for paths. A crawler named in a group follows the groups that name it and ignores the group for every crawler (User-agent: *).

To let it in

User-agent: MistralAI-Training
Allow: /

To keep it out

User-agent: MistralAI-Training
Disallow: /

Does your site let it in?

The free crawler check reads your robots.txt for MistralAI-Training and requests your page with its user agent, so it shows whether a robots.txt rule or a firewall turns it away.

Check whether your site lets MistralAI-Training in

Questions about MistralAI-Training

MistralAI-Training is a training crawler. It collects pages for this: future Mistral models. Operator: Mistral.

That is your choice. Blocking it keeps your pages out of what it collects for this: future Mistral models. It does not block the crawlers that fetch pages for answers.

Add a group with its name and a rule for every path: “User-agent: MistralAI-Training” followed by “Disallow: /”. To let it in, write “Allow: /” instead.