CRAN hotfix: arrow formats

targets 0.3.1

Bug fixes

• queue$enqueue() is now queue$prepend() and always appends to the front of the queue (#371).

Enhancements

• Throw a warning if devtools::load_all() or similar is detected inside _targets.R (#374).

CRAN

• Skip feather and parquet tests on CRAN.

Arrow formats, HPC performance, infrastructure refactor, GHA

targets 0.3.0

Bug fixes

• Fix the "write target at cursor" RStudio addin and move cursor between the parentheses.

New features

• Add a backoff option in tar_option_set() to set the maximum upper bound (seconds) for the polling interval (#333).
• Add a new tar_github_actions() function to write a GitHub Actions workflow file for continuous deployment of data analysis pipelines (#339, @jaredlander).
• Add a new TAR_MAKE_REPORTER environment variable to globally set the reporter of the tar_make*() functions (#345, @alexpghayes).
• Support new storage formats "feather", "parquet", "aws_feather", and "aws_parquet" (#355, @riazarbi).

Performance

• Implement an exponential backoff algorithm for polling the priority queue in tar_make_clustermq() and tar_make_future() (#333).
• In tar_make_future(), try to submit a target every time a worker is polled.
• In tar_make_future(), poll workers in order of target priority.
• Avoid the time delay in exiting on error (from r-lib/callr#185).
• Clone target objects for the pipeline and scrape more targets internal objects out of the environment in order to avoid accidental massive data transfers to workers.

Enhancements

• Use rlang::check_installed() inside assert_package() (#331, @malcolmbarrett).
• Allow tar_destroy(destroy = "process").
• In tar_watch(), increase default seconds to 15 (previously 5).
• In tar_watch(), debounce instead of throttle inputs.
• In tar_watch(), add an action button to refresh the outputs.
• Always deduplicate metadata after tar_make(). Will help compute a cache key on GitHub Actions and similar services.
• Deprecate tar_deduplicate() due to the item above.
• Reorder information in timestamped messages.
• Document RNG seed generation in tar_target_raw(), tar_meta(), and tar_seed() (#357, @alexpghayes).
• Switch meaning of %||% and %|||% to conform to historical precedent.
• Only show a command line spinner if reporter = "silent" (#364, @matthiasgomolka).
• Target and pipeline objects no longer have an envir element.

Nicer arguments and messages

Bug fixes

• In tar_load(), subset metadata to avoid accidental attempts to load global objects in tidyselect calls.
• Do not register a pattern as running unless an actual branch is about to start (#304).
• Use a name spec in vctrs::vec_c() (#320, @joelnitta).

New features

• Add a new names argument to tar_objects() and tar_workspaces() with tidyselect functionality.
• Record info on the main process (PID, R version, targets version) in _targets/meta/process and write new functions tar_process() and tar_pid() to retrieve the data (#291, #292).
• Add a new targets_only argument to tar_meta().
• Add new functions tar_helper() and tar_helper_raw() to write general-purpose R scripts, using tidy evaluation for as a template mechanism (#290, #291, #292, #306).
• Export functions to check the existence of various pieces of local storage: tar_exist_meta(), tar_exist_objects(), tar_exist_progress(), tar_exist_progress(), tar_exist_script() (#310).
• Add a new supervise argument to tar_watch().
• Add a new complete_only argument to tar_meta() to optionally return only complete rows (no NA values).
• Catch callr errors and refer users to the debugging chapter of the manual.

Enhancements

• Improve error messages of invalid arguments (#298, @brunocarlin). Removes partial argument matching in most cases.
• By default, locally enable crayon if an only if the calling process is interactive (#302, @ginolhac). Can still be disabled with options(crayon.enabled = FALSE) in _targets.R.
• Improve error handling and message for format = "url" when the HTTP response status code is not 200 (#303, @petrbouchal).
• Add more extras packages to tar_renv() (to support tar_watch()).
• Show informative message instead of error in tar_watch() if _targets.R does not exist.
• Clear up the documentation of the names argument of tar_load() (#314, @jameelalsalam).
• Do not override nobody in custom curl handles (#315, @riazarbi).
• Rename "running" to "started" in the progress metadata. This avoids the implicit claim that targets is somehow actively monitoring each job, e.g. through a connection or heartbeat (#318).
• Set errormode = "warn" in getVDigest() for files to work around eddelbuettel/digest#49 for network drives on Windows. targets already runs those file checks anyway. (#316, @boshek).
• If a package fails to load, print the library paths targets tried to load from.

CRAN hotfix and app improvements

Bug fixes

• tar_test() now skips all tests on Solaris in order to fix the problems shown on the CRAN check page.
• Enable allow and exclude to work on imports in tar_visnetwork() and tar_glimpse().
• Put visNetwork legends on right to deal with how legend nodes always align right within the legend space.

Performance

• Call force() on subpipeline objects to eliminate high-memory promises in target objects. Allows targets to be deployed to workers much faster when retreival is "main" (#279).

New features

• Add a new box to the tar_watch() app to tabulate progress on dynamic branches (#273, @mattwarkentin).
• Store type, parent, and branches in progress data for tar_watch() (#273, @mattwarkentin).
• Add a fields argument in tar_progress() and default to "progress" for back compatibility (#273, @mattwarkentin).
• Add a new tar_progress_branches() function to tabulate branch progress (#273, @mattwarkentin).
• Add new "refresh" switch to tar_watch() to toggle automatic refreshing and force a refresh.

Enhancements

• Exclude .Random.seed by default in tar_visnetwork().
• Spelling: "cancelled" changed to "canceled".
• Enhance controls and use of space in the tar_watch() app.
• Centralize internal path management utilities.

Configuration

• Skip clustermq tests on Solaris.

Address CRAN feedback

• Avoid starting the description with the package name.
• Remove if(FALSE) blocks from help files to fix "unexecutable code" warnings (tar_glimpse(), tar_visnetwork(), and tar_watch()).
• Remove commented code in the examples (tar_edit(), tar_watch_ui(), and tar_watch_server()).
• Ensure that all examples, tests, and vignettes do not write to the user's home file space. (Fixed an example of tar_workspace().)

First production release

Enhancements

• Accept lists of target objects at the end of _targets.R (#253).
• Deprecate tar_pipeline() and tar_bind() because of the above (#253).
• Always show a special message when the pipeline finishes (#258, @petrbouchal).
• Disable visNetwork stabilization (#264, @mattwarkentin).
• Use default visNetwork font size.
• Relay errors as condition messages if error is "continue" (#267, @liutiming).

Zenodo DOI release

0.0.0.9001

Bump version

Initial pre-release to enable Zenodo DOI

0.0.0.9000

Align internal defaults