Package: simIReff 1.0

simIReff: Stochastic Simulation for Information Retrieval Evaluation: Effectiveness Scores

Provides tools for the stochastic simulation of effectiveness scores to mitigate data-related limitations of Information Retrieval evaluation research, as described in Urbano and Nagler (2018) <doi:10.1145/3209978.3210043>. These tools include: fitting, selection and plotting distributions to model system effectiveness, transformation towards a prespecified expected value, proxy to fitting of copula models based on these distributions, and simulation of new evaluation data from these distributions and copula models.

Authors:Julián Urbano [aut, cre], Thomas Nagler [ctb]

simIReff_1.0.tar.gz
simIReff_1.0.zip(r-4.5)simIReff_1.0.zip(r-4.4)simIReff_1.0.zip(r-4.3)
simIReff_1.0.tgz(r-4.4-any)simIReff_1.0.tgz(r-4.3-any)
simIReff_1.0.tar.gz(r-4.5-noble)simIReff_1.0.tar.gz(r-4.4-noble)
simIReff_1.0.tgz(r-4.4-emscripten)simIReff_1.0.tgz(r-4.3-emscripten)
simIReff.pdf |simIReff.html✨
simIReff/json (API)

# Install 'simIReff' in R:
install.packages('simIReff', repos = c('https://julian-urbano.r-universe.dev', 'https://cloud.r-project.org'))

Peer review:

Bug tracker:https://github.com/julian-urbano/simireff/issues

Datasets:

On CRAN:

29 exports 0.62 score 79 dependencies 20 scripts 106 downloads

Last updated 6 years agofrom:2c38960ba1. Checks:OK: 7. Indexed: yes.

TargetResultDate
Doc / VignettesOKSep 04 2024
R-4.5-winOKSep 04 2024
R-4.5-linuxOKSep 04 2024
R-4.4-winOKSep 04 2024
R-4.4-macOKSep 04 2024
R-4.3-winOKSep 04 2024
R-4.3-macOKSep 04 2024

Exports:capdeffdploteffCont_betaeffCont_bkseffCont_nkseffCont_normeffContFiteffContFitAndSelecteffContMeaneffContTrunceffContVareffcopFiteffDisc_bbinomeffDisc_dkseffDiscFiteffDiscFitAndSelecteffSelecteffTransformeffTransformAllmatchTolpeffpplotqeffqplotreffreffcopsupportwhich.effSelect

Dependencies:assertthatbase64encbdeBHbootbslibcachemclicolorspacecommonmarkcrayoncubaturedigestextraDistrfansifarverfastmapFNNfontawesomefsggplot2gluegtablehtmltoolshttpuvisobandjquerylibjsonlitekde1dkernlabKernSmoothkslabelinglaterlatticelifecyclemagrittrMASSMatrixMatrixModelsmclustmemoisemgcvmimemulticoolmunsellmvtnormnlmenppillarpkgconfigpracmapromisesquadprogquantregR6randtoolboxrappdirsRColorBrewerRcppRcppEigenRcppThreadrlangrngWELLrvinecopulibsassscalesshinysourcetoolsSparseMsurvivaltibbletruncnormutf8vctrsviridisLitewdmwithrxtable

Readme and manuals

Help Manual

Help pageTopics
'simIReff': Stochastic Simulation for Information Retrieval Evaluation: Effectiveness ScoressimIReff-package simIReff
Effectiveness Distributionsdeff eff peff qeff reff
Class 'eff.cont'eff.cont-class effCont_new
Class 'eff.disc'eff.disc-class effDisc_new
Continuous Effectiveness DistributionseffCont
Continuous Effectiveness as Beta Distribution.effCont_beta
Continuous Effectiveness as Beta Kernel-smoothed Distribution.effCont_bks
Continuous Effectiveness as Truncated Gaussian Kernel-smoothed Distribution.effCont_nks
Continuous Effectiveness as Truncated Normal Distribution.effCont_norm
Helper functions for continuous effectiveness distributionscap effCont-helper effContMean effContTrunc effContVar
Fit Vine copula models to matrices of effectiveness scoreseffcop effcopFit reffcop
Discrete Effectiveness DistributionseffDisc
Discrete Effectiveness as Beta-Binomial Distribution.effDisc_bbinom
Discrete Effectiveness as Discrete Kernel-smoothed Distribution.effDisc_dks
Helper functions for discrete effectiveness distributionseffDisc-helper matchTol support
Fit Effectiveness DistributionseffContFit effDiscFit effFit
Automatic Fitting and Selection of Effectiveness DistributionseffContFitAndSelect effDiscFitAndSelect effFitAndSelect
Model Selection for Effectiveness DistributionseffSelect logLik.eff which.effSelect
Transform effectiveness distributions towards a expected valueeffTransform effTransformAll
Plotting tools for effectiveness distributionsdplot plot.eff pplot qplot
Plotting tools for Continuous effectiveness distributionsdplot.eff.cont plot.eff.cont pplot.eff.cont qplot.eff.cont
Plotting tools for Discrete effectiveness distributionsdplot.eff.disc plot.eff.disc pplot.eff.disc qplot.eff.disc
TREC 2010 Web Ad hoc track.web2010ap web2010p20 web2010rr