Package: simIReff 1.0

simIReff: Stochastic Simulation for Information Retrieval Evaluation: Effectiveness Scores

Provides tools for the stochastic simulation of effectiveness scores to mitigate data-related limitations of Information Retrieval evaluation research, as described in Urbano and Nagler (2018) <doi:10.1145/3209978.3210043>. These tools include: fitting, selection and plotting distributions to model system effectiveness, transformation towards a prespecified expected value, proxy to fitting of copula models based on these distributions, and simulation of new evaluation data from these distributions and copula models.

Authors:Julián Urbano [aut, cre], Thomas Nagler [ctb]

simIReff_1.0.tar.gz
simIReff_1.0.zip(r-4.7)simIReff_1.0.zip(r-4.6)simIReff_1.0.zip(r-4.5)
simIReff_1.0.tgz(r-4.6-any)simIReff_1.0.tgz(r-4.5-any)
simIReff_1.0.tar.gz(r-4.7-any)simIReff_1.0.tar.gz(r-4.6-any)
simIReff_1.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
card.svg |card.png
simIReff/json (API)

# Install 'simIReff' in R:
install.packages('simIReff', repos = c('https://julian-urbano.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/julian-urbano/simireff/issues

Datasets:

On CRAN:

Conda:

3.00 score 20 scripts 308 downloads 29 exports 75 dependencies

Last updated from:2c38960ba1. Checks:9 OK. Indexed: yes.

TargetResultTimeFilesSyslog
linux-devel-x86_64OK154
source / vignettesOK179
linux-release-x86_64OK154
macos-release-arm64OK161
macos-oldrel-arm64OK170
windows-develOK98
windows-releaseOK111
windows-oldrelOK95
wasm-releaseOK131

Exports:capdeffdploteffCont_betaeffCont_bkseffCont_nkseffCont_normeffContFiteffContFitAndSelecteffContMeaneffContTrunceffContVareffcopFiteffDisc_bbinomeffDisc_dkseffDiscFiteffDiscFitAndSelecteffSelecteffTransformeffTransformAllmatchTolpeffpplotqeffqplotreffreffcopsupportwhich.effSelect

Dependencies:assertthatbase64encbdeBHbootbslibcachemclicommonmarkcpp11cubaturedigestextraDistrfarverfastmapFNNfontawesomefsggplot2gluegtablehtmltoolshttpuvisobandjquerylibjsonlitekde1dkernlabKernSmoothkslabelinglaterlatticelifecyclemagrittrMASSMatrixMatrixModelsmclustmemoisemgcvmimemulticoolmvtnormnlmenpotelpracmapromisesquadprogquantregR6randtoolboxrappdirsRColorBrewerRcppRcppArmadilloRcppEigenRcppThreadrlangrngWELLrvinecopulibS7sassscalesshinysourcetoolsSparseMsurvivaltruncnormvctrsviridisLitewdmwithrxtable

Readme and manuals

Help Manual

Help pageTopics
'simIReff': Stochastic Simulation for Information Retrieval Evaluation: Effectiveness ScoressimIReff-package simIReff
Effectiveness Distributionsdeff eff peff qeff reff
Class 'eff.cont'eff.cont-class effCont_new
Class 'eff.disc'eff.disc-class effDisc_new
Continuous Effectiveness DistributionseffCont
Continuous Effectiveness as Beta Distribution.effCont_beta
Continuous Effectiveness as Beta Kernel-smoothed Distribution.effCont_bks
Continuous Effectiveness as Truncated Gaussian Kernel-smoothed Distribution.effCont_nks
Continuous Effectiveness as Truncated Normal Distribution.effCont_norm
Helper functions for continuous effectiveness distributionscap effCont-helper effContMean effContTrunc effContVar
Fit Vine copula models to matrices of effectiveness scoreseffcop effcopFit reffcop
Discrete Effectiveness DistributionseffDisc
Discrete Effectiveness as Beta-Binomial Distribution.effDisc_bbinom
Discrete Effectiveness as Discrete Kernel-smoothed Distribution.effDisc_dks
Helper functions for discrete effectiveness distributionseffDisc-helper matchTol support
Fit Effectiveness DistributionseffContFit effDiscFit effFit
Automatic Fitting and Selection of Effectiveness DistributionseffContFitAndSelect effDiscFitAndSelect effFitAndSelect
Model Selection for Effectiveness DistributionseffSelect logLik.eff which.effSelect
Transform effectiveness distributions towards a expected valueeffTransform effTransformAll
Plotting tools for effectiveness distributionsdplot plot.eff pplot qplot
Plotting tools for Continuous effectiveness distributionsdplot.eff.cont plot.eff.cont pplot.eff.cont qplot.eff.cont
Plotting tools for Discrete effectiveness distributionsdplot.eff.disc plot.eff.disc pplot.eff.disc qplot.eff.disc
TREC 2010 Web Ad hoc track.web2010ap web2010p20 web2010rr