Custom Quality Frameworks

A quality framework is a combination of error categories and severities used to label issues found in a translation, along with Error per Thousand Words (EPT) thresholds. More details about these combinations are provided below.

Matecat has a default quality framework that it uses for all projects for which a custom quality framework is not chosen. 

Using a customized quality framework

You can use custom quality frameworks to suit your specific requirements by modifying the EPT thresholds and the values in the evaluation grid.

EPT thresholds

The scoring system used in Matecat is Error per Thousand Words (EPT). EPT thresholds determine whether projects pass or fail at each revision stage based on their EPT score. The default values are 8 for R1 and 5 for R2. 

A project passes a certain revision stage when its EPT score in that stage is below or equal to the set threshold. Any value exceeding the threshold will result in a "Fail," while values below the threshold will secure a "Pass". You can change the thresholds to tailor them to your needs.

Evaluation grid

The evaluation grid manages categories and severity levels during revision. Categories are used to categorize the type of error found, while severity levels measure the gravity of the error.

Severity levels are category-specific, meaning you can assign different weights to the same severity level depending on the category.

You can edit, move up/down, delete and add new categories.
Categories have both a name and a description; when creating or editing a category, you can manage both.

You can also add a severity if you need.

The new severity will be added to the grid.

If necessary, you can also remove severities.

You can decide to remove a severity only for specific categories, in which case it will still be available for the others.

Alternatively, you can remove the severity entirely from all categories.

Any changes to the default quality framework will be highlighted in blue and will trigger the option to save the current settings either as a new configuration or, if you are editing an existing configuration, as a new version of it.

Even if you don’t save the configuration, the new settings are still applied to the project you are currently creating.

To use a custom quality framework in a project template, first save the settings in a configuration (either new or existing).

If you create a new configuration or edit an existing one that is not yet linked to the current project template, link the configuration to the template and save the template.

If you edit a configuration that is already linked to the current project template, you don’t need to save the template again, as the changes take effect automatically.