Class PromptBasedEvaluator

java.lang.Object
io.micronaut.langchain4j.evaluation.PromptBasedEvaluator
All Implemented Interfaces:
Evaluator
Direct Known Subclasses:
FactCheckingEvaluator, RelevancyEvaluator
public abstract class PromptBasedEvaluator extends Object implements Evaluator
Base class for evaluators that use a judge model.
Since:
2.1.1

  • Constructor Details

    • PromptBasedEvaluator

      protected PromptBasedEvaluator(@NonNull dev.langchain4j.model.chat.ChatModel chatModel)
      Parameters:
      chatModel - The judge model
      Since:
      2.1.1

  • Method Details

    • evaluate

      public @NonNull EvaluationResult evaluate(@NonNull EvaluationRequest request)
      Description copied from interface: Evaluator
      Evaluate the given request.
      Specified by:
      evaluate in interface Evaluator
      Parameters:
      request - The request to evaluate
      Returns:
      The evaluation result

    • evaluationName

      protected abstract @NonNull String evaluationName()
      Returns:
      The evaluation name shown to the judge model
      Since:
      2.1.1

    • evaluationCriteria

      protected abstract @NonNull String evaluationCriteria()
      Returns:
      The evaluation criteria shown to the judge model
      Since:
      2.1.1

    • validate

      protected void validate(@NonNull EvaluationRequest request)
      Allows subclasses to validate the request before evaluation.
      Parameters:
      request - The request
      Since:
      2.1.1