Simple Dandisets on staging not validating in under two minutes

[jwodder]

Once again, the backups2datalad tests are failing because the test Dandisets created by the tests are not validating for publication in time.

[waxlamp]

@jwodder, can you point us to a specific failing test so we can try to see what's going on?

[jwodder]

@waxlamp https://github.com/dandi/dandisets/actions/runs/3446135222/jobs/5750937513

[yarikoptic]

citing for posterity

FAILED test_backups2datalad/test_core.py::test_1 - ValueError: Dandiset 205806 is Invalid: {
    "asset_validation_errors": [
        {
            "field": "new.txt",
            "message": "asset is currently being validated, please wait."
        }
    ],
    "version_validation_errors": []
}
FAILED test_backups2datalad/test_core.py::test_2 - ValueError: Dandiset 205810 is Invalid: {
    "asset_validation_errors": [
        {
            "field": "counter.txt",
            "message": "asset is currently being validated, please wait."
        }
    ],
    "version_validation_errors": []
}
FAILED test_backups2datalad/test_core.py::test_3 - ValueError: Dandiset 205812 is Invalid: {
    "asset_validation_errors": [
        {
            "field": "counter.txt",
            "message": "asset is currently being validated, please wait."
        }
    ],
    "version_validation_errors": []
}
FAILED test_backups2datalad/test_core.py::test_4 - ValueError: Dandiset 205814 is Invalid: {
    "asset_validation_errors": [
        {
            "field": "counter.txt",
            "message": "asset is currently being validated, please wait."
        }
    ],
    "version_validation_errors": []
}
=================== 4 failed, 11 passed in 684.93s (0:11:24) ===================

[yarikoptic]

I still wonder how we have "missed" that while testing against dandi-cli... @jwodder -- don't we have some tests in dandi-cli which would cause similar workflow? if so -- then I guess the problem lies in the difference of "real deployment" from simple docker-compose one.

[jwodder]

@yarikoptic Yes, there are dandi-cli tests that publish Dandisets, so presumably the problem lies with the staging instance.

[yarikoptic]

is this still the case @jwodder?

[jwodder]

@yarikoptic No, this seems to have been resolved between December 5 and December 11.