Package: vitals Title: Large Language Model Evaluation Version: 0.3.0.9000 Authors@R: c( person("Simon", "Couch", , "simon.couch@posit.co", role = c("aut", "cre"), comment = c(ORCID = "0000-0001-5676-5107")), person("Max", "Kuhn", , "max@posit.co", role = "ctb"), person("Hadley", "Wickham", , "hadley@posit.co", role = "ctb", comment = c(ORCID = "0000-0003-4757-117X")), person("Mine", "Cetinkaya-Rundel", , "mine@posit.co", role = "ctb", comment = c(ORCID = "0000-0001-6452-2420")), person("Posit Software, PBC", role = c("cph", "fnd"), comment = c(ROR = "03wc8by49")) ) Description: A port of 'Inspect', a widely adopted 'Python' framework for large language model evaluation. Specifically aimed at 'ellmer' users who want to measure the effectiveness of their large language model-based products, the package supports prompt engineering, tool usage, multi-turn dialog, and model graded evaluations. License: MIT + file LICENSE URL: https://github.com/tidyverse/vitals, https://vitals.tidyverse.org BugReports: https://github.com/tidyverse/vitals/issues Depends: R (>= 4.1) Imports: cli, dplyr, ellmer (>= 0.4.0), glue, httpuv, httr2, jsonlite, purrr, R6, rlang, S7, tibble, tidyr, withr Suggests: ggplot2, here, htmltools, knitr, magick, ordinal, rmarkdown, testthat (>= 3.0.0), vcr (>= 2.0.0) Config/Needs/website: tidyverse/tidytemplate, rmarkdown, btw, tidyverse, gt, brms, RcppEigen, broom, gt Config/testthat/edition: 3 Config/testthat/parallel: true Config/usethis/last-upkeep: 2025-04-25 Config/testthat/start-first: task, translate Encoding: UTF-8 LazyData: true Roxygen: list(markdown = TRUE) RoxygenNote: 7.3.3 Config/pak/sysreqs: make libicu-dev libssl-dev zlib1g-dev Repository: https://tidyverse.r-universe.dev Date/Publication: 2026-06-10 14:42:34 UTC RemoteUrl: https://github.com/tidyverse/vitals RemoteRef: HEAD RemoteSha: 8f0c4af7d89b922de0606b4c825a05230c68dfe1 NeedsCompilation: no Packaged: 2026-06-21 06:13:48 UTC; root Author: Simon Couch [aut, cre] (ORCID: ), Max Kuhn [ctb], Hadley Wickham [ctb] (ORCID: ), Mine Cetinkaya-Rundel [ctb] (ORCID: ), Posit Software, PBC [cph, fnd] (ROR: ) Maintainer: Simon Couch