Microsoft Foundry built-in evaluator grader — foundry_grader_azure

Reference a Microsoft Foundry built-in evaluator (a builtin.* ID such as builtin.coherence or builtin.groundedness) as a grader. Built-in evaluators run only on a Foundry project endpoint; foundry_eval_create() and foundry_evaluate() switch to it when a grader of this type is present.

Usage

foundry_grader_azure_ai(
  name,
  evaluator_name,
  initialization_parameters = NULL,
  data_mapping = NULL,
  evaluator_version = NULL
)

Arguments

name: Character. Grader name shown in results.
evaluator_name: Character. The evaluator ID, e.g. "builtin.coherence".
initialization_parameters: List. Optional parameters passed to the evaluator. Model-graded evaluators take the judge deployment as list(deployment_name = "gpt-5-mini").
data_mapping: Named list. Optional mapping from evaluator inputs to dataset templates, e.g. list(query = "{{item.query}}", response = "{{sample.output_text}}").
evaluator_version: Character. Optional evaluator version. Defaults to the latest version on the service when omitted.

Value

A named list describing an azure_ai_evaluator grader.

Examples

foundry_grader_azure_ai(
  name = "coherence",
  evaluator_name = "builtin.coherence",
  initialization_parameters = list(deployment_name = "gpt-5-mini"),
  data_mapping = list(
    query = "{{item.query}}",
    response = "{{sample.output_text}}"
  )
)
#> $type
#> [1] "azure_ai_evaluator"
#> 
#> $name
#> [1] "coherence"
#> 
#> $evaluator_name
#> [1] "builtin.coherence"
#> 
#> $initialization_parameters
#> $initialization_parameters$deployment_name
#> [1] "gpt-5-mini"
#> 
#> 
#> $data_mapping
#> $data_mapping$query
#> [1] "{{item.query}}"
#> 
#> $data_mapping$response
#> [1] "{{sample.output_text}}"
#> 
#>